-- Logs begin at Fri 2022-07-29 07:42:44 UTC, end at Fri 2022-07-29 08:56:26 UTC. -- Jul 29 08:17:37.905220 dv-cinder-819149-15-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 29 08:17:37.913956 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 08:17:37 2022] *** Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: nodename: dv-cinder-819149-15-iscsi Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: machine: x86_64 Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: clock source: unix Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: pcre jit disabled Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: detected number of CPU cores: 4 Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: current working directory: / Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: detected binary path: /usr/bin/uwsgi-core Jul 29 08:17:37.915943 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: your processes number limit is 47680 Jul 29 08:17:37.916505 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: your memory page size is 4096 bytes Jul 29 08:17:37.916505 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: detected max file descriptor number: 2048 Jul 29 08:17:37.916505 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: lock engine: pthread robust mutexes Jul 29 08:17:37.916505 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: thunder lock: enabled Jul 29 08:17:37.916505 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 29 08:17:37.916505 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 08:17:37.954616 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: Python main interpreter initialized at 0x55b3dc12a9c0 Jul 29 08:17:37.954616 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: python threads support enabled Jul 29 08:17:37.954616 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: your server socket listen backlog is limited to 100 connections Jul 29 08:17:37.954616 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: your mercy for graceful operations on workers is 90 seconds Jul 29 08:17:37.954980 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 08:17:37.955058 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: *** Operational MODE: preforking *** Jul 29 08:17:37.955386 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: *** uWSGI is running in multiple interpreter mode *** Jul 29 08:17:37.955386 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: spawned uWSGI master process (pid: 80197) Jul 29 08:17:37.955606 dv-cinder-819149-15-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 29 08:17:37.956505 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: spawned uWSGI worker 1 (pid: 80209, cores: 1) Jul 29 08:17:37.956772 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: spawned uWSGI worker 2 (pid: 80210, cores: 1) Jul 29 08:17:37.957958 dv-cinder-819149-15-iscsi devstack@keystone.service[80197]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 08:17:43.379307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:17:43.379307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: from cryptography.utils import int_from_bytes Jul 29 08:17:43.380132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:17:43.380132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: from cryptography.utils import int_from_bytes Jul 29 08:17:43.380240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:17:43.380240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: from cryptography.utils import int_from_bytes Jul 29 08:17:43.380240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:17:43.380240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: from cryptography.utils import int_from_bytes Jul 29 08:17:43.428992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 08:17:43.429169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 08:17:43.429380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] command line args: [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 08:17:43.429648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 08:17:43.429779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 08:17:43.429779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ================================================================================ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 08:17:43.429921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 08:17:43.429986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] command line args: [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 08:17:43.430044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] admin_token = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.430285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config_dir = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.430414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 08:17:43.430414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ================================================================================ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 08:17:43.430555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.430615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config_source = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.430669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] admin_token = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.430808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] debug = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.430961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config_dir = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.431040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config_source = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] debug = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.432973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_config_append = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_dir = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_config_append = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_dir = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.433936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.434938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.435998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.436183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.436316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.436394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.436678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.436813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.436903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] publish_errors = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] publish_errors = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.437949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.438078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.438231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.438373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] standard_threads = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.438498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.438620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.438748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.438971 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.439104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] standard_threads = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.439241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.439369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.439495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_journal = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.439495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_json = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.439748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.439879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_stderr = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_syslog = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_journal = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_json = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_stderr = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.440863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_syslog = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.440988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.441130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:17:43.441256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.441419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.441562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.441689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.441829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.441979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442516 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.442970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.443981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.444953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.445076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.445155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.445461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.445602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.445684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.445906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.446924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.447912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.448125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.448249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.448379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.448558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.448696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.448823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.448954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.449084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.449266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.449266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.449627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.449749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.449882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.450011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.450250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.450386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.450522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.450661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.450792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.450923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.451932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.452934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.453967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.454045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.454314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.454437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.454530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.454768 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.454890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.454969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.455176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.455315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.455473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.455621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.455756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.455899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.456956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.457985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.458979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.459142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.459354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.459437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.459575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.459825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.459907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.460063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.460256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.460339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.460519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.460692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.460784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.460967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.461112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.461195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.461437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.461520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.461671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.461897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.461979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.462915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.external = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.463862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.password = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.464982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.token = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.465943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466273 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.466966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.467902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.468901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.469417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.469529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.469652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.external = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.469755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.469887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.469967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.password = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.token = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.470956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.471919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.472862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.473850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.474966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.475044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.475213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.475292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.475443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.475530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.475680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.475928 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.476944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.477954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.478921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.479996 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.480946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.481929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.482849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.483832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.484889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.485017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.485128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.485260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.485385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.485519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.485737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.485874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.486903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.487883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.488937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.489180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.489402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.489495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.489685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.490857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.491964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.492105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.492210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.492444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.492697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.492775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.492926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.493969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.494135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.494214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.494374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.494613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.494825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.494904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.495075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.495323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.495471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.495550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.495730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.495810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.495983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.496942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.497181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.497334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.497419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.497580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.497659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.497883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.498951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.499117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.499200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.499360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.499635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.499715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.499884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.499962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.500917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.501078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.501158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.501345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.501537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.501617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.501772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.501935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.502980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.503924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.504957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.505935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.506871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507273 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.507986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.508936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.509999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.510166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.510244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.510416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.510503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.510663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.510751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.510920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.511897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.512999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.513955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.514818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 08:17:43.514913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.515177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.515418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.515654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.515893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.516139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.516377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.516632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.516879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.517118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.517384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.517629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.517877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.518114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.518354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.518588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.518832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.519082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.519314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.519559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.519854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.520117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.520365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.520614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.520852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.521092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.521349 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.521589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.521826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.522063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.522309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.522545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.522788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.523022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.523270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.523510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.523767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.524000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.524241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.524476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:17:43.524647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 08:17:43.543888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.544118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.544343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.549446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.549680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.549908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.552676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.558242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.582267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.582492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.585806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.586009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.634470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.635193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.683979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.684223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.685102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.685338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.748095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.748324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.748419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.748547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.748731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.748818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.748958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.749039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.749160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.749250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.749392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.749518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.772190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.772314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.772575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.772782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.773032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.773250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.773462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.773572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.773703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.773960 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.774180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.774399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.774620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.774834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.784587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.785628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.797501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.797741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.797969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.798176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.798356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.798607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.798821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.800803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.801211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.801650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.802054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.802442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.802781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.803008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 08:17:43.816041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.816224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 08:17:43.816588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.816833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 08:17:43.817024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.817319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.817440 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.817596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 08:17:43.817740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.817865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.818049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.818049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 08:17:43.818285 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.818581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.818842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.819064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.827413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.827714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.827977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.828257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.829036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.829310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.829608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.829888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.835229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.836996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.839957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.840236 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.840506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.840778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.841049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.841271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.841584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.841849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.842110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.842378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.842636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.843649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.843933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.844892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.845603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.845880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.846139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.846400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.847446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.847727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.848002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.848270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.866005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.867482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.867757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.871357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.872380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.872659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.872864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.872965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.873114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.877829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.878106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.878383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.879546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.879820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.884047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.884340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.884623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.884898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.885117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.885211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.885419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.885503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.885699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.885969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.889831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.890123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.890462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.890741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.891012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.891305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.891583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.891858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.901972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.902243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.906223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.907839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.908116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.909377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.909668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.912060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.914060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.915253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.915547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.917243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.919974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.920422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.920717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.921001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.921314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.921640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.921931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.923248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.926437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.926750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.927025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.927320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.927592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.927875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.937924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.938206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.938469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.938725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.943946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.944235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.944501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.944769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.945613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.947170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.947444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.950272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.950552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.950856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.951133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.951416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.951780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.953414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.953689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.956512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.956796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.957095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.957398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.957682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.962918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.963198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.963476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.963746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.964025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.964294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.964566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.972021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.972511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.972910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.973380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.973825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.974306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.974759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.980687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.983668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.986710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.989187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.990702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.990825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.990967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.991277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.993814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:43.996797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.997852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.999317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:43.999441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:44.000853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:44.001147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.001467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.002814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.003282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.003755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.004078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.007984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.009625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:44.012569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.012855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.013138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.013444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.014085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:44.014378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.014658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.021953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:44.022301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.022535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.024888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:44.025322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.025772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.026137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.026521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.026946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.027358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.027795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.028415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.028900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.029385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.029489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 08:17:44.029670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.029787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.029945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.030215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.030312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.030513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.030724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.030812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.031087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.031397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.031821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.032102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.032382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.032662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.032935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.033195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 08:17:44.064401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b3dc12a9c0 pid: 80209 (default app) Jul 29 08:17:44.066902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b3dc12a9c0 pid: 80210 (default app) Jul 29 08:17:44.067805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755308af-ce63-44dd-90a2-2ae535b5154b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:44.068093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755308af-ce63-44dd-90a2-2ae535b5154b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:44.068371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755308af-ce63-44dd-90a2-2ae535b5154b None None] PATH_INFO: `/v3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:44.072774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Fri Jul 29 08:17:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:17:51.701562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a64b8-fd39-484c-b4c2-d67cff47b8ed None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:51.702204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a64b8-fd39-484c-b4c2-d67cff47b8ed None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:51.702302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a64b8-fd39-484c-b4c2-d67cff47b8ed None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:51.706821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:17:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:17:51.715252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:51.715659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:51.715850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:51.791789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: INFO dbcounter [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] Registered counter for database keystone Jul 29 08:17:51.814881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG oslo_db.sqlalchemy.engines [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:17:51.825863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writer thread running {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:17:52.023244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG passlib.handlers.bcrypt [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80209) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 29 08:17:52.023704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG passlib.handlers.bcrypt [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80209) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 29 08:17:52.081884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:17:52.083528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:17:52.210440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:17:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 29 08:17:52.341099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a64b8-fd39-484c-b4c2-d67cff47b8ed None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:52.425296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: INFO dbcounter [None req-018a64b8-fd39-484c-b4c2-d67cff47b8ed None None] Registered counter for database keystone Jul 29 08:17:52.448073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG oslo_db.sqlalchemy.engines [None req-018a64b8-fd39-484c-b4c2-d67cff47b8ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:17:52.458401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writer thread running {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:17:52.584536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a64b8-fd39-484c-b4c2-d67cff47b8ed None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:52.590006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df479d-35d7-49bd-aaed-9373b646f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:52.590658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df479d-35d7-49bd-aaed-9373b646f141 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:52.590943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df479d-35d7-49bd-aaed-9373b646f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:52.591271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df479d-35d7-49bd-aaed-9373b646f141 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:52.600253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df479d-35d7-49bd-aaed-9373b646f141 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:52.651658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING keystone.common.rbac_enforcer.enforcer [None req-55df479d-35d7-49bd-aaed-9373b646f141 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 29 08:17:52.651987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df479d-35d7-49bd-aaed-9373b646f141 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:52.662786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Fri Jul 29 08:17:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:17:52.669905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:52.691859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950db6f6-db1e-4727-b756-f57064072a30 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:52.697970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fa1ea-fa6d-45de-8cf8-e8c6900079ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:52.699092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa1ea-fa6d-45de-8cf8-e8c6900079ff admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:52.699373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa1ea-fa6d-45de-8cf8-e8c6900079ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:52.699740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa1ea-fa6d-45de-8cf8-e8c6900079ff admin admin] PATH_INFO: `/v3/projects/946d886e0ff64f17b40801862b894e7d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:52.701422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fa1ea-fa6d-45de-8cf8-e8c6900079ff admin admin] RBAC: Authorizing `identity:get_project(project_id=946d886e0ff64f17b40801862b894e7d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:52.751886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f80fa1ea-fa6d-45de-8cf8-e8c6900079ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 29 08:17:52.752472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fa1ea-fa6d-45de-8cf8-e8c6900079ff admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:52.756910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Fri Jul 29 08:17:52 2022] GET /identity/v3/projects/946d886e0ff64f17b40801862b894e7d => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:17:54.738828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66d6ba-ba36-4ea0-9d02-82f0991e0c78 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:54.739715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66d6ba-ba36-4ea0-9d02-82f0991e0c78 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:54.739715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66d6ba-ba36-4ea0-9d02-82f0991e0c78 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:54.746661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:17:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:17:54.752319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476549c6-0ce4-43a1-a049-30dfce9c3da3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:54.752745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476549c6-0ce4-43a1-a049-30dfce9c3da3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:54.752835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476549c6-0ce4-43a1-a049-30dfce9c3da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:54.774741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-476549c6-0ce4-43a1-a049-30dfce9c3da3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:17:54.776260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-476549c6-0ce4-43a1-a049-30dfce9c3da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:17:54.785537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:17:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 29 08:17:54.807914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66d6ba-ba36-4ea0-9d02-82f0991e0c78 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:54.824374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66d6ba-ba36-4ea0-9d02-82f0991e0c78 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:54.829797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363a09f-03c2-49b0-a080-0af3a228b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:54.830408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a09f-03c2-49b0-a080-0af3a228b50b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:54.830697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a09f-03c2-49b0-a080-0af3a228b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:54.830978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a09f-03c2-49b0-a080-0af3a228b50b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:54.839178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363a09f-03c2-49b0-a080-0af3a228b50b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:54.840965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363a09f-03c2-49b0-a080-0af3a228b50b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:54.850450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Fri Jul 29 08:17:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:17:54.858448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476549c6-0ce4-43a1-a049-30dfce9c3da3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:54.872415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476549c6-0ce4-43a1-a049-30dfce9c3da3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:54.878657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5228de-1a0b-4c83-a86b-e5c0fd448dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:54.879283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5228de-1a0b-4c83-a86b-e5c0fd448dca admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:54.879560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5228de-1a0b-4c83-a86b-e5c0fd448dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:54.879841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5228de-1a0b-4c83-a86b-e5c0fd448dca admin admin] PATH_INFO: `/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:54.881242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5228de-1a0b-4c83-a86b-e5c0fd448dca admin admin] RBAC: Authorizing `identity:get_user(user_id=2b0c94cc4dbe432d8153b2bd96ed5e97)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:54.883104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5228de-1a0b-4c83-a86b-e5c0fd448dca admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:54.884624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Fri Jul 29 08:17:54 2022] GET /identity/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:17:56.929705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0c53-eb87-425e-aac8-6a3b11fd90f2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:56.930341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0c53-eb87-425e-aac8-6a3b11fd90f2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:56.930341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0c53-eb87-425e-aac8-6a3b11fd90f2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:56.931861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:17:56.932094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cfc8-67bd-49d6-b2a7-db8563518018 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:56.932481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cfc8-67bd-49d6-b2a7-db8563518018 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:56.932558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cfc8-67bd-49d6-b2a7-db8563518018 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:56.933942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:17:56.936818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:56.937107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:56.937810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:56.938975 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557bd0d-a0f3-43c1-870a-7617645faa0a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:56.939261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557bd0d-a0f3-43c1-870a-7617645faa0a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:56.939542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557bd0d-a0f3-43c1-870a-7617645faa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:56.959861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e557bd0d-a0f3-43c1-870a-7617645faa0a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:17:56.961051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e557bd0d-a0f3-43c1-870a-7617645faa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:17:56.981573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG passlib.handlers.bcrypt [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80210) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 29 08:17:56.982029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG passlib.handlers.bcrypt [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80210) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 29 08:17:57.026909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:17:57.028521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:17:57.044632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 7/12] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:17:57.066593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557bd0d-a0f3-43c1-870a-7617645faa0a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.091932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:17:57.131591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 6/13] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:17:57.153963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.171067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557bd0d-a0f3-43c1-870a-7617645faa0a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.203369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.203963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.204245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.204521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.254378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b176a9-433a-4a08-8540-ae2701c18094 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.257675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:17:57.273927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:57.275334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:57.293132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.294291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.294580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.294863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.297785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:17:57.307271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:17:57.315936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:17:57.316966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:17:57.317822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:17:57.324801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.384567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:17:57.392395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.432697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba40b-287a-44ad-a7a3-2c74fceb121b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.465454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.466013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.466292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.466566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.467287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:17:57.467590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:57.469446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:57.481052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 8/16] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:17:57.486663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.491913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861474d-edde-4d85-abd6-f34de6be5a66 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.514536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:17:57.514973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:17:57.526858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.527513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.527795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.528070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.538189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:57.539673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:17:57.558207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:17:57.559041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:17:57.559829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:17:57.559829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:17:57.559829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:17:57.559829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:17:57.559829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:17:57.565387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.591600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ae1e-037f-47c1-aa1f-628eb4df3821 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.626305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.626956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.627235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.627694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] PATH_INFO: `/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.629018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] RBAC: Authorizing `identity:get_user(user_id=2b0c94cc4dbe432d8153b2bd96ed5e97)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:57.630525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:57.632226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:17:57.642644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.747789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:17:57.755693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6b1d5-d4ac-4759-a6f4-f8101051fbfd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.776838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780fb83-de96-48d1-bda4-e7afc8e0e1e5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.789155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.789830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.790111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.790367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.791868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:57.793379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:57.794965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:17:57.800994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:17:57.810435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602555e0-f06f-4e4c-8762-9d2d79ad7698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.811070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602555e0-f06f-4e4c-8762-9d2d79ad7698 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.811357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602555e0-f06f-4e4c-8762-9d2d79ad7698 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.811638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602555e0-f06f-4e4c-8762-9d2d79ad7698 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.812343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602555e0-f06f-4e4c-8762-9d2d79ad7698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:17:57.812650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602555e0-f06f-4e4c-8762-9d2d79ad7698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:57.814252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602555e0-f06f-4e4c-8762-9d2d79ad7698 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:57.831441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:17:57.911287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40edcf4-cdd3-4587-9924-729dc3b6ac94 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:17:57.951268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3608a66-dae6-422f-9f8d-d5bfb60782f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:17:57.951955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608a66-dae6-422f-9f8d-d5bfb60782f7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:17:57.952158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608a66-dae6-422f-9f8d-d5bfb60782f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:17:57.952464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608a66-dae6-422f-9f8d-d5bfb60782f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:17:57.953320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3608a66-dae6-422f-9f8d-d5bfb60782f7 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.domain.id=default, user.id=2b0c94cc4dbe432d8153b2bd96ed5e97) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:17:57.953625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3608a66-dae6-422f-9f8d-d5bfb60782f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:17:57.955156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3608a66-dae6-422f-9f8d-d5bfb60782f7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:17:57.964515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Fri Jul 29 08:17:57 2022] GET /identity/v3/role_assignments?user.id=2b0c94cc4dbe432d8153b2bd96ed5e97&scope.domain.id=default&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:00.071414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58749f-ce70-45ae-91b5-ac8ff4193ae3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.072490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58749f-ce70-45ae-91b5-ac8ff4193ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.072983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58749f-ce70-45ae-91b5-ac8ff4193ae3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.074594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:00.079906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9fd72-5383-4e45-a11c-ab9c6ed84b8e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.080711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9fd72-5383-4e45-a11c-ab9c6ed84b8e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.081173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9fd72-5383-4e45-a11c-ab9c6ed84b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.104898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-54c9fd72-5383-4e45-a11c-ab9c6ed84b8e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:00.106479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-54c9fd72-5383-4e45-a11c-ab9c6ed84b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:00.133891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:00.188611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 12/23] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:00.222682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58749f-ce70-45ae-91b5-ac8ff4193ae3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:00.273695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:00.378566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58749f-ce70-45ae-91b5-ac8ff4193ae3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:00.402559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5d64-9bf1-45f4-99ee-7453a557759c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.403187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5d64-9bf1-45f4-99ee-7453a557759c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.403652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5d64-9bf1-45f4-99ee-7453a557759c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.405213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:00.415439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04668-01c0-4440-99cc-52fb924af24a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.416011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04668-01c0-4440-99cc-52fb924af24a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.416479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04668-01c0-4440-99cc-52fb924af24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.423188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:00.424220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.424510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.424795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.446626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-aae04668-01c0-4440-99cc-52fb924af24a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:00.448347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-aae04668-01c0-4440-99cc-52fb924af24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:00.461330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:00.467383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:00.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:00.469432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 12/25] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:00.478464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:00.566517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 14/26] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:00.604080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04668-01c0-4440-99cc-52fb924af24a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:00.691863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:00.717383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985f54f-1539-440c-8750-2f85db8da254 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:00.774765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:00.796024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04668-01c0-4440-99cc-52fb924af24a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:00.806802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd2bcd-3811-42b6-adbb-62d315009418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:00.807459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2bcd-3811-42b6-adbb-62d315009418 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.807744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2bcd-3811-42b6-adbb-62d315009418 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.808022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2bcd-3811-42b6-adbb-62d315009418 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.808780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd2bcd-3811-42b6-adbb-62d315009418 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:00.809082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd2bcd-3811-42b6-adbb-62d315009418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:00.810561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd2bcd-3811-42b6-adbb-62d315009418 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:00.829911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 13/27] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:00.832786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912bd2-a13a-41fe-aafa-deeca01738b2 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.833079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912bd2-a13a-41fe-aafa-deeca01738b2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.833378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912bd2-a13a-41fe-aafa-deeca01738b2 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.835769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 14/28] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:00.836934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2117f7-04aa-409d-80a2-76d4bdd914b4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.837216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2117f7-04aa-409d-80a2-76d4bdd914b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.837532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2117f7-04aa-409d-80a2-76d4bdd914b4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.839007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 15/29] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:00.839504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2117f7-04aa-409d-80a2-76d4bdd914b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:00.861341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4f41-9290-4c1f-adf8-fa163144d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:00.861991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4f41-9290-4c1f-adf8-fa163144d32a None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:00.862277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4f41-9290-4c1f-adf8-fa163144d32a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:00.862559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4f41-9290-4c1f-adf8-fa163144d32a None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:00.863296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b4f41-9290-4c1f-adf8-fa163144d32a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:00.864866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b4f41-9290-4c1f-adf8-fa163144d32a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:00.976669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2117f7-04aa-409d-80a2-76d4bdd914b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.017858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6800e-07b1-4ba8-a939-f994bfbc1c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.018851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6800e-07b1-4ba8-a939-f994bfbc1c90 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.019329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6800e-07b1-4ba8-a939-f994bfbc1c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.019765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6800e-07b1-4ba8-a939-f994bfbc1c90 None admin] PATH_INFO: `/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.021099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6800e-07b1-4ba8-a939-f994bfbc1c90 None admin] RBAC: Authorizing `identity:get_user(user_id=2b0c94cc4dbe432d8153b2bd96ed5e97)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.023583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6800e-07b1-4ba8-a939-f994bfbc1c90 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.026124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 16/30] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:00 2022] GET /identity/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:01.031858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595796fc-ea4d-4366-8c0d-b9e6e9195ad3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.032321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595796fc-ea4d-4366-8c0d-b9e6e9195ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.032823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595796fc-ea4d-4366-8c0d-b9e6e9195ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.054222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-595796fc-ea4d-4366-8c0d-b9e6e9195ad3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:01.055650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-595796fc-ea4d-4366-8c0d-b9e6e9195ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:01.074232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:01.109732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 15/31] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Jul 29 08:18:00 2022] POST /identity/v3/roles => generated 219 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:01.112222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140259d-8d48-49ee-9796-18edc0d4d501 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.112705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140259d-8d48-49ee-9796-18edc0d4d501 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.113185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140259d-8d48-49ee-9796-18edc0d4d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.134066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e140259d-8d48-49ee-9796-18edc0d4d501 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:01.136022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e140259d-8d48-49ee-9796-18edc0d4d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:01.137507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 17/32] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:01.138442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595796fc-ea4d-4366-8c0d-b9e6e9195ad3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:01.213769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:01.215236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140259d-8d48-49ee-9796-18edc0d4d501 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:01.278501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595796fc-ea4d-4366-8c0d-b9e6e9195ad3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.318947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.319917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.320372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.320838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.322408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.324131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.324715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:01.327240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 18/34] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:01.328722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:01.358245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:01.359727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140259d-8d48-49ee-9796-18edc0d4d501 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.400315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.401308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.401816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.402249 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.403175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.404939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.430496 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 17/35] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Jul 29 08:18:01 2022] POST /identity/v3/roles => generated 225 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:01.431771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:01.448855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d03d2-841f-4407-aeca-a1a6665c34a7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.490490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac85c-41a3-4fcb-9a5a-f403119adac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.491491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac85c-41a3-4fcb-9a5a-f403119adac8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.491914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac85c-41a3-4fcb-9a5a-f403119adac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.492360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac85c-41a3-4fcb-9a5a-f403119adac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.505355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac85c-41a3-4fcb-9a5a-f403119adac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.507287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac85c-41a3-4fcb-9a5a-f403119adac8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-771ac85c-41a3-4fcb-9a5a-f403119adac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:18:01.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:01.527227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:01.528058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:18:01.528058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:18:01.528058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:18:01.528058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:01.530031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 19/36] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:01.531874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2922aa-0de8-4880-8e69-b23c692457c6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.532311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2922aa-0de8-4880-8e69-b23c692457c6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.532839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2922aa-0de8-4880-8e69-b23c692457c6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.535060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 20/37] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:01.536235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2922aa-0de8-4880-8e69-b23c692457c6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:01.554646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56398070-4d2f-4e2a-8ae9-e759d645317a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.596330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25c4e6-090e-492f-a661-689848cb3cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.597041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c4e6-090e-492f-a661-689848cb3cd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.597356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c4e6-090e-492f-a661-689848cb3cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.597652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c4e6-090e-492f-a661-689848cb3cd2 None admin] PATH_INFO: `/v3/domains/default/users/2b0c94cc4dbe432d8153b2bd96ed5e97/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.600046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25c4e6-090e-492f-a661-689848cb3cd2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2b0c94cc4dbe432d8153b2bd96ed5e97, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.601589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25c4e6-090e-492f-a661-689848cb3cd2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.606291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:01.625480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 18/38] 10.222.0.47 () {58 vars in 1361 bytes} [Fri Jul 29 08:18:01 2022] PUT /identity/v3/domains/default/users/2b0c94cc4dbe432d8153b2bd96ed5e97/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:01.627521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a03e-c760-4034-925d-23477719db8a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.627840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a03e-c760-4034-925d-23477719db8a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.628184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a03e-c760-4034-925d-23477719db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.635254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:01.666547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9da3a03e-c760-4034-925d-23477719db8a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:01.667822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9da3a03e-c760-4034-925d-23477719db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:01.671968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2922aa-0de8-4880-8e69-b23c692457c6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.711518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.712143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.712430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.712754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.713689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:01.714003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.715563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.730744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 21/39] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:01.737040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:01.765436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 19/40] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:01.790218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a03e-c760-4034-925d-23477719db8a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:01.864874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82274c93-78b7-4b91-b814-033f2150b174 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.907920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.908571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.908857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.909138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.910311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.911800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.917164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:01.922952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a03e-c760-4034-925d-23477719db8a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:01.951036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:01.960628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31394033-3426-4a7f-9ac9-c32e565b2c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:01.961266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394033-3426-4a7f-9ac9-c32e565b2c4a None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.961576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394033-3426-4a7f-9ac9-c32e565b2c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.961860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394033-3426-4a7f-9ac9-c32e565b2c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.962588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31394033-3426-4a7f-9ac9-c32e565b2c4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:01.963975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31394033-3426-4a7f-9ac9-c32e565b2c4a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:01.980971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Jul 29 08:18:01 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:18:01.988243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabd64-4f51-47d9-9838-54161790c424 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.988901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabd64-4f51-47d9-9838-54161790c424 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.989520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabd64-4f51-47d9-9838-54161790c424 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:01.991505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 21/42] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:01.998080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d5b8-a94d-4a36-88de-e9d5943792a9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:01.999090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d5b8-a94d-4a36-88de-e9d5943792a9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:01.999865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d5b8-a94d-4a36-88de-e9d5943792a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:02.022735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1cd2d5b8-a94d-4a36-88de-e9d5943792a9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:02.024454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1cd2d5b8-a94d-4a36-88de-e9d5943792a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:02.056753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 22/43] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:18:01 2022] POST /identity/v3/projects => generated 301 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:02.112578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 22/44] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:02.135490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:02.257461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417cdbe-2713-4b32-a56b-303f3e972013 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:02.292507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e140f-16c2-4027-9cac-350e8175e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:02.293089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e140f-16c2-4027-9cac-350e8175e664 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:02.293405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e140f-16c2-4027-9cac-350e8175e664 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:02.293688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e140f-16c2-4027-9cac-350e8175e664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:02.294913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e140f-16c2-4027-9cac-350e8175e664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:02.296490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e140f-16c2-4027-9cac-350e8175e664 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:02.298158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 23/45] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:02.304224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d5b8-a94d-4a36-88de-e9d5943792a9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:02.401146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d5b8-a94d-4a36-88de-e9d5943792a9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:02.417950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:02.437052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e813ad-6e17-48e7-b38a-c74fd60de923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:02.437763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e813ad-6e17-48e7-b38a-c74fd60de923 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:02.438048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e813ad-6e17-48e7-b38a-c74fd60de923 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:02.438327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e813ad-6e17-48e7-b38a-c74fd60de923 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:02.439015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e813ad-6e17-48e7-b38a-c74fd60de923 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:02.440480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e813ad-6e17-48e7-b38a-c74fd60de923 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:02.477758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:18:02 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:18:03.706662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486616b-cfd2-4952-b784-e94720c4df09 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:03.707212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486616b-cfd2-4952-b784-e94720c4df09 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:03.707212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486616b-cfd2-4952-b784-e94720c4df09 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:03.708560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 24/47] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:03.713939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f119fc6-3b7d-42cc-93ea-4d3342fa6905 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:03.714324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f119fc6-3b7d-42cc-93ea-4d3342fa6905 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:03.714505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f119fc6-3b7d-42cc-93ea-4d3342fa6905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:03.734200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1f119fc6-3b7d-42cc-93ea-4d3342fa6905 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:03.735403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1f119fc6-3b7d-42cc-93ea-4d3342fa6905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:03.805137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:03.827333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486616b-cfd2-4952-b784-e94720c4df09 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:03.888651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:03.934224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486616b-cfd2-4952-b784-e94720c4df09 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:03.968907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:03.969487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:03.969770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:03.970047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:03.980753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:03.986017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:03.987195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:03.988136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 25/49] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:03.993252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f119fc6-3b7d-42cc-93ea-4d3342fa6905 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:04.092082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:04.096473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f119fc6-3b7d-42cc-93ea-4d3342fa6905 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:04.131387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:04.132021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.132305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.132587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.133326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:04.133648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:04.135054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:04.143388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 25/50] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:04.148973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:04.258950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456270c5-fb17-4a81-9820-6acf894338b1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:04.273139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:04.294252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:04.294899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.295184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.295458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] PATH_INFO: `/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.296729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] RBAC: Authorizing `identity:get_user(user_id=2b0c94cc4dbe432d8153b2bd96ed5e97)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:04.298334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:04.299927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 26/51] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:04 2022] GET /identity/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:04.305663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:04.410874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec3ae-87c5-46a0-94cd-c92a4e90075d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:04.445634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed3c8-da20-4d14-9b1b-355efde36e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:04.446288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed3c8-da20-4d14-9b1b-355efde36e4a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.446576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed3c8-da20-4d14-9b1b-355efde36e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.446840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed3c8-da20-4d14-9b1b-355efde36e4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.448062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed3c8-da20-4d14-9b1b-355efde36e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:04.449556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed3c8-da20-4d14-9b1b-355efde36e4a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:04.451198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 26/52] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:04.457310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:04.465329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82046ee-8e76-46e3-b5c9-01ad96a3ed4b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.465617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82046ee-8e76-46e3-b5c9-01ad96a3ed4b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.465906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82046ee-8e76-46e3-b5c9-01ad96a3ed4b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.467209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 27/53] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:04.472449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bc21-9e70-43e0-a94f-e92ab88d0f22 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.472739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bc21-9e70-43e0-a94f-e92ab88d0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.473024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bc21-9e70-43e0-a94f-e92ab88d0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.493716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1703bc21-9e70-43e0-a94f-e92ab88d0f22 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:04.494955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1703bc21-9e70-43e0-a94f-e92ab88d0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:04.517713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:04.560474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abc351-7f00-4d59-a8ee-82a23a5cc718 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:04.565996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 28/54] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:04.590663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bc21-9e70-43e0-a94f-e92ab88d0f22 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:04.595497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:04.596139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.596425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.596702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.597545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.domain.id=default, user.id=2b0c94cc4dbe432d8153b2bd96ed5e97) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:04.597863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:04.599365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:04.606783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1322 bytes} [Fri Jul 29 08:18:04 2022] GET /identity/v3/role_assignments?user.id=2b0c94cc4dbe432d8153b2bd96ed5e97&scope.domain.id=default&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:04.703250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bc21-9e70-43e0-a94f-e92ab88d0f22 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:04.741193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fced46-e794-47d2-abad-6e066191a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:04.741964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fced46-e794-47d2-abad-6e066191a897 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.742172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fced46-e794-47d2-abad-6e066191a897 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.742455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fced46-e794-47d2-abad-6e066191a897 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.743725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fced46-e794-47d2-abad-6e066191a897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:04.745211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fced46-e794-47d2-abad-6e066191a897 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:04.746907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 29/56] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:04.752999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:04.804500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:04.858725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc75483-f3ce-48b0-a2bd-2fb38a6d4573 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:04.893730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cf5cb-e1d2-46d6-99f5-870a14a9590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:04.894344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cf5cb-e1d2-46d6-99f5-870a14a9590f None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:04.894623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cf5cb-e1d2-46d6-99f5-870a14a9590f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:04.894909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cf5cb-e1d2-46d6-99f5-870a14a9590f None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:04.895603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cf5cb-e1d2-46d6-99f5-870a14a9590f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:04.897077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cf5cb-e1d2-46d6-99f5-870a14a9590f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:04.928666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 28/57] 10.222.0.47 () {60 vars in 1140 bytes} [Fri Jul 29 08:18:04 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:06.901033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d57512-b991-400f-b26a-b957125df692 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:06.901936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d57512-b991-400f-b26a-b957125df692 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:06.902074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d57512-b991-400f-b26a-b957125df692 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:06.904206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 30/58] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:06.909642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159cbac-9592-4792-8b5b-7852fb2f1264 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:06.910052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159cbac-9592-4792-8b5b-7852fb2f1264 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:06.910174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159cbac-9592-4792-8b5b-7852fb2f1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:06.929864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5159cbac-9592-4792-8b5b-7852fb2f1264 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:06.931371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5159cbac-9592-4792-8b5b-7852fb2f1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:07.006200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 29/59] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:07.030669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d57512-b991-400f-b26a-b957125df692 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:07.065782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:07.141234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d57512-b991-400f-b26a-b957125df692 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:07.179939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad587f72-93c3-4760-95ef-5c5a5b35ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:07.180527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587f72-93c3-4760-95ef-5c5a5b35ee8d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:07.180816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587f72-93c3-4760-95ef-5c5a5b35ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:07.181096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587f72-93c3-4760-95ef-5c5a5b35ee8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:07.182365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad587f72-93c3-4760-95ef-5c5a5b35ee8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:07.183825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad587f72-93c3-4760-95ef-5c5a5b35ee8d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:07.185444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 31/60] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:07.191077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159cbac-9592-4792-8b5b-7852fb2f1264 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:07.219897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:07.290531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159cbac-9592-4792-8b5b-7852fb2f1264 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:07.325322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c6b9c-08dc-4a54-8316-f9d19a167887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:07.325966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6b9c-08dc-4a54-8316-f9d19a167887 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:07.326250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6b9c-08dc-4a54-8316-f9d19a167887 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:07.326526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6b9c-08dc-4a54-8316-f9d19a167887 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:07.327212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c6b9c-08dc-4a54-8316-f9d19a167887 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:07.328789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c6b9c-08dc-4a54-8316-f9d19a167887 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:07.361756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 30/61] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:18:07 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:10.505155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8b3e-d0a6-45db-8c4a-0e4156e44d09 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.506057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8b3e-d0a6-45db-8c4a-0e4156e44d09 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.506480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8b3e-d0a6-45db-8c4a-0e4156e44d09 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:10.507988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 32/62] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:10.513400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fed8c-2b5b-4489-bc4a-39f1364043b1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.514135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fed8c-2b5b-4489-bc4a-39f1364043b1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.514570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fed8c-2b5b-4489-bc4a-39f1364043b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:10.531053 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438879-622b-4aad-ba95-89debb50b7cd None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.531685 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438879-622b-4aad-ba95-89debb50b7cd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.532177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438879-622b-4aad-ba95-89debb50b7cd None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:10.533857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 33/63] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:10.539227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1232-18bc-4fce-9dc8-30ad1cb0da81 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.539749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1232-18bc-4fce-9dc8-30ad1cb0da81 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.540222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1232-18bc-4fce-9dc8-30ad1cb0da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:10.545315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4a1fed8c-2b5b-4489-bc4a-39f1364043b1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:10.545315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4a1fed8c-2b5b-4489-bc4a-39f1364043b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:10.562713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b45c1232-18bc-4fce-9dc8-30ad1cb0da81 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:10.564315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b45c1232-18bc-4fce-9dc8-30ad1cb0da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:10.665226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 31/64] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:10.693472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fed8c-2b5b-4489-bc4a-39f1364043b1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:10.703170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 34/65] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:10.710874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea78c-af6c-44d3-8add-619bf037563f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.711470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea78c-af6c-44d3-8add-619bf037563f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.711942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea78c-af6c-44d3-8add-619bf037563f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:10.713751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 35/66] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:10.719791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554dce-8e48-48de-bab4-9201322be842 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.720387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554dce-8e48-48de-bab4-9201322be842 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.721060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554dce-8e48-48de-bab4-9201322be842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:10.721793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:10.745206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-82554dce-8e48-48de-bab4-9201322be842 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:10.746679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-82554dce-8e48-48de-bab4-9201322be842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:10.769385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:10.831878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fed8c-2b5b-4489-bc4a-39f1364043b1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:10.832666 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 36/67] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:10.833811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554dce-8e48-48de-bab4-9201322be842 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:10.882824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:10.883901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.884399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.884864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:10.896905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:10.902177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:10.903089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 32/68] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:10.904224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:10.954980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554dce-8e48-48de-bab4-9201322be842 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:10.991590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:10.992244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:10.992526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:10.992803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.003534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:11.004030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:11.008479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:11.009394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:11.010157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 37/69] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:11.010786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.028540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.036002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8fb8-3b62-432c-8778-89facbae1b4f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.071481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed9b72-9018-4226-84a9-fc0bc0218202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.072133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9b72-9018-4226-84a9-fc0bc0218202 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.072415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9b72-9018-4226-84a9-fc0bc0218202 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.072691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9b72-9018-4226-84a9-fc0bc0218202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.083088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed9b72-9018-4226-84a9-fc0bc0218202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-66ed9b72-9018-4226-84a9-fc0bc0218202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:11.088574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:11.095064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 33/70] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:11.096015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae479-b755-415a-a73d-074b6ea44549 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.096689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae479-b755-415a-a73d-074b6ea44549 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.096689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae479-b755-415a-a73d-074b6ea44549 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.096689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 34/71] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:11.096689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ae479-b755-415a-a73d-074b6ea44549 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.127874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590e18-fdff-4b37-8c02-0134bf5c82a8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.166210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.166844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.167135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.167418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.168151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:11.168460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.169890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:11.178133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 38/72] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:11.182227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.196090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ae479-b755-415a-a73d-074b6ea44549 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.232921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0bcd0-d20c-4c58-81bb-bfea14351df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.233594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0bcd0-d20c-4c58-81bb-bfea14351df3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.233881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0bcd0-d20c-4c58-81bb-bfea14351df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.234166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0bcd0-d20c-4c58-81bb-bfea14351df3 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.234892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0bcd0-d20c-4c58-81bb-bfea14351df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:11.235189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0bcd0-d20c-4c58-81bb-bfea14351df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.238123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0bcd0-d20c-4c58-81bb-bfea14351df3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:11.238551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.248087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 35/73] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:11.249433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88dcd8-dfd6-47ed-9cc3-414d4af765f3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.249729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88dcd8-dfd6-47ed-9cc3-414d4af765f3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.250012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88dcd8-dfd6-47ed-9cc3-414d4af765f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.265559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.267966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8b88dcd8-dfd6-47ed-9cc3-414d4af765f3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:11.269213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8b88dcd8-dfd6-47ed-9cc3-414d4af765f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:11.289962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1316-43e2-4739-8947-eba5000f4ba0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.322731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f2c5-b9d0-4ac6-a56e-b6ce62f9fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.323363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f2c5-b9d0-4ac6-a56e-b6ce62f9fbaf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.323650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f2c5-b9d0-4ac6-a56e-b6ce62f9fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.323932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f2c5-b9d0-4ac6-a56e-b6ce62f9fbaf None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.324666 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f2c5-b9d0-4ac6-a56e-b6ce62f9fbaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:11.324977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f2c5-b9d0-4ac6-a56e-b6ce62f9fbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.326403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f2c5-b9d0-4ac6-a56e-b6ce62f9fbaf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:11.334377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 39/74] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:11.335605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a6243-6689-4a6b-9082-07fde08a5288 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.335899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a6243-6689-4a6b-9082-07fde08a5288 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.336180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a6243-6689-4a6b-9082-07fde08a5288 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.337419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 40/75] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:11.338041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 36/76] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:11.341543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a6243-6689-4a6b-9082-07fde08a5288 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.342414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88dcd8-dfd6-47ed-9cc3-414d4af765f3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.444581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a6243-6689-4a6b-9082-07fde08a5288 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.452062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88dcd8-dfd6-47ed-9cc3-414d4af765f3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.477160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d48e70-21cd-4921-9d71-5d9f45bc2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.477795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d48e70-21cd-4921-9d71-5d9f45bc2753 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.478079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d48e70-21cd-4921-9d71-5d9f45bc2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.478358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d48e70-21cd-4921-9d71-5d9f45bc2753 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.479828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.486393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.489217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.489914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.490202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.490480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] PATH_INFO: `/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.491676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] RBAC: Authorizing `identity:get_user(user_id=2b0c94cc4dbe432d8153b2bd96ed5e97)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.493173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:11.494485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d48e70-21cd-4921-9d71-5d9f45bc2753 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.494821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 37/77] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:11.499635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.499752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d48e70-21cd-4921-9d71-5d9f45bc2753 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:11.499752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 41/78] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:11.499752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c123f6-2d82-4181-9486-3b71cf3b410a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.499752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c123f6-2d82-4181-9486-3b71cf3b410a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.499752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c123f6-2d82-4181-9486-3b71cf3b410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.517072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-49c123f6-2d82-4181-9486-3b71cf3b410a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:11.518336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-49c123f6-2d82-4181-9486-3b71cf3b410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:11.583843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 42/79] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:11.597494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c123f6-2d82-4181-9486-3b71cf3b410a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.597640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8a070-a935-4f01-af05-c7209cae0671 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.630395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.631031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.631314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.631588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.633406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.635267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:11.637747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 38/80] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:11.640009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.701094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.703628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c123f6-2d82-4181-9486-3b71cf3b410a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.730833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.740493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.741155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.741473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.741762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.743623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b80852-997c-4a74-bac3-737490f42156 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.751765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:11.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:11.757641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:11.758553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 43/81] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:11.759704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.783325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.783959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.784260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.784527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.854013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.855447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:11.856880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174d304-bc24-4e34-83c1-482e89bad7e1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:11.894030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:11.894679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:11.894969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:11.895253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:11.916959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.952034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:11.959033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 39/82] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:11.959886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:11.967207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:11.969067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.059442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143e332-8c8f-4a62-a3b4-6240e8adf905 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.067048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 44/83] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:12.067888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.094202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.094851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.095172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.095437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.096595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.098117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.099846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 40/84] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.100527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.130448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.158038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.172654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297fce-4598-4e74-9f4f-effc4486f845 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.201125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb8f11-196b-476c-b377-a69b09e1f51b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.206604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.207753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.208271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.208719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.235220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.236184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.236658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.237135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.238404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:12.238955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.240583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.250131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 41/85] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.251119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.283534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.285026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.342373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.352337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c7692-52e6-4ac6-94eb-5046ead6efd8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.368776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.384800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 45/86] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:12.385611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.387327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.387986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.388267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.389269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.390115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.391571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.393300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 42/87] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.394031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.490017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cba2af-564b-4889-90c0-e97b6bc4751e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.491069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd843b-70da-463f-9001-e30e89e936d1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.521900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.522542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.522831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.523097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.523207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.523831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.524121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.524248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.524405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.525088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.525737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.526563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.527398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 46/88] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.528164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.548015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 43/89] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:18:12 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:12.548892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.589757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.595815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.647101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406204f4-69f7-4cbd-99fd-f57181f01524 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.684004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.684670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.684954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.685234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.686493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.687968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.689758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 47/90] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.690539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ba10-9f2d-4758-a8b5-aeeaa8b24394 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.691007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.735786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a449-6335-4410-9254-a55c170da854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.736468 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a449-6335-4410-9254-a55c170da854 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.736750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a449-6335-4410-9254-a55c170da854 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.737023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a449-6335-4410-9254-a55c170da854 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.738207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a449-6335-4410-9254-a55c170da854 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.741126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a449-6335-4410-9254-a55c170da854 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.741738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 44/91] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.742917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a449-6335-4410-9254-a55c170da854 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.827246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302505bf-fa3d-4093-9e5f-dc6a19cd2adc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.843930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.854474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:12.862599 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a449-6335-4410-9254-a55c170da854 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:12.871018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.871661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.871966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.872669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.875876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=2b0c94cc4dbe432d8153b2bd96ed5e97) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:12.875876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.876751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.886869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 48/92] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/role_assignments?user.id=2b0c94cc4dbe432d8153b2bd96ed5e97&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.889322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:12.904313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:12.905184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:12.905653 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:12.906135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:12.907090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=bd86b132728e4bdb90e02c8095adc0ff) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:12.907637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:12.909351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:12.917079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 45/93] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/role_assignments?user.id=bd86b132728e4bdb90e02c8095adc0ff&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=bd4182637160412da90e2d257ec550ce => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:12.918421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:13.095884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00263b2-43bc-496d-b8d7-c10b9f64b3c3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:13.143248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6896da-bc42-4151-ac53-f27130e0bca1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:13.177644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:13.178213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:13.178505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:13.178782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:13.195125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:13.195889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:13.196267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:13.196640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:13.197565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] RBAC: Adding query filter params (role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=bd86b132728e4bdb90e02c8095adc0ff) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:13.197971 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:13.199562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:13.205839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 46/94] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/role_assignments?user.id=bd86b132728e4bdb90e02c8095adc0ff&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=d8ac88c62f844b499ed53400465ff365 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:13.282455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:13.306110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:13.307885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:13.449333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:13.450359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 49/95] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:13.472137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:13.579964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1f2ba-1f73-4a10-8b18-d6001026c1fa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:13.618656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f345f24-1472-47c1-9f72-72cae1f71a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:13.619593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345f24-1472-47c1-9f72-72cae1f71a1b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:13.620006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345f24-1472-47c1-9f72-72cae1f71a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:13.620409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345f24-1472-47c1-9f72-72cae1f71a1b None admin] PATH_INFO: `/v3/projects/2ddfea93400848cf828bf9661d1c1008` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:13.621761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f345f24-1472-47c1-9f72-72cae1f71a1b None admin] RBAC: Authorizing `identity:get_project(project_id=2ddfea93400848cf828bf9661d1c1008)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:13.623366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f345f24-1472-47c1-9f72-72cae1f71a1b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:13.625175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 47/96] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:13 2022] GET /identity/v3/projects/2ddfea93400848cf828bf9661d1c1008 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:13.631374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:13.771804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:13.790455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657da9a-3ee0-4253-a371-7c33550dd073 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:13.836337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a43cf8-dd61-413e-9a47-8163f40afa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:13.836994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43cf8-dd61-413e-9a47-8163f40afa83 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:13.837300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43cf8-dd61-413e-9a47-8163f40afa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:13.837586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43cf8-dd61-413e-9a47-8163f40afa83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:13.838395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a43cf8-dd61-413e-9a47-8163f40afa83 None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=2ddfea93400848cf828bf9661d1c1008, user.id=bd86b132728e4bdb90e02c8095adc0ff) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:13.838712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a43cf8-dd61-413e-9a47-8163f40afa83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:13.840186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a43cf8-dd61-413e-9a47-8163f40afa83 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:13.849582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 50/97] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:13 2022] GET /identity/v3/role_assignments?user.id=bd86b132728e4bdb90e02c8095adc0ff&scope.project.id=2ddfea93400848cf828bf9661d1c1008&role.id=bd4182637160412da90e2d257ec550ce => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:15.815546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f413-d980-4d9d-a507-23e43c07fc12 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:15.816569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f413-d980-4d9d-a507-23e43c07fc12 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:15.817043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f413-d980-4d9d-a507-23e43c07fc12 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:15.818658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 48/98] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:15.830855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b886-26f1-4330-8e35-2085e236ef31 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:15.831343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b886-26f1-4330-8e35-2085e236ef31 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:15.831417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b886-26f1-4330-8e35-2085e236ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:15.858289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-69a4b886-26f1-4330-8e35-2085e236ef31 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:15.859514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-69a4b886-26f1-4330-8e35-2085e236ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:15.879262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a899c-b767-4d15-a2f4-aabcd8683e0b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:15.879584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a899c-b767-4d15-a2f4-aabcd8683e0b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:15.879836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a899c-b767-4d15-a2f4-aabcd8683e0b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:15.881291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 49/99] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:15.898741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42477-0555-4007-8a49-cf20c4e15ea7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:15.899024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42477-0555-4007-8a49-cf20c4e15ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:15.899306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42477-0555-4007-8a49-cf20c4e15ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:15.926250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-afd42477-0555-4007-8a49-cf20c4e15ea7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:15.927477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-afd42477-0555-4007-8a49-cf20c4e15ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:15.958576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 51/100] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:15.960477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549d97a-ff08-4dfc-93ab-8bb191249b57 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:15.960774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549d97a-ff08-4dfc-93ab-8bb191249b57 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:15.961218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549d97a-ff08-4dfc-93ab-8bb191249b57 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:15.966682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 52/101] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:15.979086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb39b3-49a8-4ef7-919f-f150b17760d1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:15.979375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb39b3-49a8-4ef7-919f-f150b17760d1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:15.979661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb39b3-49a8-4ef7-919f-f150b17760d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.009779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9fcb39b3-49a8-4ef7-919f-f150b17760d1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:16.011585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9fcb39b3-49a8-4ef7-919f-f150b17760d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:16.042917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 50/102] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 29 08:18:16.043803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42477-0555-4007-8a49-cf20c4e15ea7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.065025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.108405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 53/103] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:16.110395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb39b3-49a8-4ef7-919f-f150b17760d1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.142082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.215233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42477-0555-4007-8a49-cf20c4e15ea7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.232070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb39b3-49a8-4ef7-919f-f150b17760d1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.256774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd449-7de8-402b-a1f5-8f1f2c44e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.257586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd449-7de8-402b-a1f5-8f1f2c44e5ed None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.257970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd449-7de8-402b-a1f5-8f1f2c44e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.258328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd449-7de8-402b-a1f5-8f1f2c44e5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.269027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfd449-7de8-402b-a1f5-8f1f2c44e5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:16.271786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa9f3-e4bd-4cfb-8b98-bd5e4ab02b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.272596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa9f3-e4bd-4cfb-8b98-bd5e4ab02b9a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.273012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa9f3-e4bd-4cfb-8b98-bd5e4ab02b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.273468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa9f3-e4bd-4cfb-8b98-bd5e4ab02b9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1fcfd449-7de8-402b-a1f5-8f1f2c44e5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:16.274024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:16.275084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:16.276081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 51/104] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:16.281112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cce1a-09d2-4891-a109-eac2e97f7483 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.281433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cce1a-09d2-4891-a109-eac2e97f7483 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.281727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cce1a-09d2-4891-a109-eac2e97f7483 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.283064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 52/105] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:16.283064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cce1a-09d2-4891-a109-eac2e97f7483 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.292809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa9f3-e4bd-4cfb-8b98-bd5e4ab02b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bb9aa9f3-e4bd-4cfb-8b98-bd5e4ab02b9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:16.298066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:16.298948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:16.299736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 54/106] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:16.300817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8bf8e-787f-4a6e-a277-dc157ef919e1 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.301152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8bf8e-787f-4a6e-a277-dc157ef919e1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.301456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8bf8e-787f-4a6e-a277-dc157ef919e1 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.303211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 55/107] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:16.304075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8bf8e-787f-4a6e-a277-dc157ef919e1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.368567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.377991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.402463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cce1a-09d2-4891-a109-eac2e97f7483 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.408652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8bf8e-787f-4a6e-a277-dc157ef919e1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.436962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.437745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.438035 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.438311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.441785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90243151-1901-46c8-8572-7bfec2e6eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.442428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90243151-1901-46c8-8572-7bfec2e6eca4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.442708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90243151-1901-46c8-8572-7bfec2e6eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.442988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90243151-1901-46c8-8572-7bfec2e6eca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.443765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90243151-1901-46c8-8572-7bfec2e6eca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:16.444020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90243151-1901-46c8-8572-7bfec2e6eca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:16.445414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90243151-1901-46c8-8572-7bfec2e6eca4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:16.448324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:16.453320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:16.454358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:16.455291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:16.455972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 56/108] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:16.456057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 53/109] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:16.456133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583d4f-a5b2-4110-8792-22ea608f0828 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.456133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583d4f-a5b2-4110-8792-22ea608f0828 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.456133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583d4f-a5b2-4110-8792-22ea608f0828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.456326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.476047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-48583d4f-a5b2-4110-8792-22ea608f0828 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:16.477254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-48583d4f-a5b2-4110-8792-22ea608f0828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:16.540806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 57/110] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:16.542089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c471c9-299f-4b5c-8849-5ed6ae2875ff None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.542384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c471c9-299f-4b5c-8849-5ed6ae2875ff None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.542658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c471c9-299f-4b5c-8849-5ed6ae2875ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.568295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-86c471c9-299f-4b5c-8849-5ed6ae2875ff None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:16.569517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-86c471c9-299f-4b5c-8849-5ed6ae2875ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:16.575850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4598e-4c62-4e66-8b28-88ec581e8a99 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.604368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.610767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9f4a8-0857-4634-997c-4ee516cc8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.611387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f4a8-0857-4634-997c-4ee516cc8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.611708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f4a8-0857-4634-997c-4ee516cc8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.611961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f4a8-0857-4634-997c-4ee516cc8aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.612677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9f4a8-0857-4634-997c-4ee516cc8aa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:16.612976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9f4a8-0857-4634-997c-4ee516cc8aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:16.614390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9f4a8-0857-4634-997c-4ee516cc8aa7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:16.627251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 54/111] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:16.627251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273222-a8b6-431b-92f2-0130f9a16097 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.627251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273222-a8b6-431b-92f2-0130f9a16097 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.627251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273222-a8b6-431b-92f2-0130f9a16097 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.627251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 55/112] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:16.627251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273222-a8b6-431b-92f2-0130f9a16097 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.632127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.642736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 58/113] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:16.643572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c471c9-299f-4b5c-8849-5ed6ae2875ff None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.733766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273222-a8b6-431b-92f2-0130f9a16097 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.758239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c471c9-299f-4b5c-8849-5ed6ae2875ff None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.770946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.771595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.771894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.772211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] PATH_INFO: `/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.773748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] RBAC: Authorizing `identity:get_user(user_id=2b0c94cc4dbe432d8153b2bd96ed5e97)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:16.776118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:16.782725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 56/114] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:16.782725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.797314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.798065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.798352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.798631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.799359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:16.799669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:16.801038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:16.809190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 59/115] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:16.810023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.842891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.866310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:16.883571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf24f3b-4b7d-4854-927c-40dfa6b313af None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.911736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b75d-6bb9-4dfe-a767-a05b6fa93f1c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:16.915774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33b13-75d7-46fa-a2df-02fa32235f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.916420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33b13-75d7-46fa-a2df-02fa32235f1b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.916704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33b13-75d7-46fa-a2df-02fa32235f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.916980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33b13-75d7-46fa-a2df-02fa32235f1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.927602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe33b13-75d7-46fa-a2df-02fa32235f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1fe33b13-75d7-46fa-a2df-02fa32235f1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:16.933045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:16.934010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 57/116] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:16.940152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928487f3-20cf-4938-8ac5-631bb07e2ada None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.940993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928487f3-20cf-4938-8ac5-631bb07e2ada None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.940993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928487f3-20cf-4938-8ac5-631bb07e2ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.945501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:16.946160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:16.946447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:16.946727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:16.947951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:16.949428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:16.955393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 60/117] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:16.955393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:16.956548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-928487f3-20cf-4938-8ac5-631bb07e2ada None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:16.957778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-928487f3-20cf-4938-8ac5-631bb07e2ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:17.023210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 58/118] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:17.024154 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928487f3-20cf-4938-8ac5-631bb07e2ada None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.068037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37e416-dd6c-4bc1-8e5d-30e1fbc96a50 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.074844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.090382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.102489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.103139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.103426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.103705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.104851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.106326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.107939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 61/119] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:17.107939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.131503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928487f3-20cf-4938-8ac5-631bb07e2ada None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.166070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.166641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.166925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.167196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.168383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.169899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.171598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 59/120] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:17.174153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.208850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769696-6947-4aa6-a5a8-cc75e5197367 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.242699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.243358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.243653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.243933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.245219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.246713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.249732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 62/121] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:17.249732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.276384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde3882-2452-4396-82ac-92fe28df5e46 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.294503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.308503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.311625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.312262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.312547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.312827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.313659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:17.313969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.315382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.324190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 60/122] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:17.324976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.351351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca6e0-4786-43a1-8aa9-414597ccc467 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.383832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.384476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.384760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.385033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.386210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.387702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.389557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 63/123] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:17.390210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.425147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8f2e-c97c-47fa-9dcf-4507b164a262 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.458477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.459116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.459389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.459663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.469807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:17.475138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:17.476088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:17.476915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 61/124] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:17.477612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.493956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9709e3-e885-4678-b5c7-533e5eb21dcf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.518433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.519398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.529490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.530124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.530412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.530693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.531389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.532855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.560268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 64/125] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:18:17 2022] POST /identity/v3/projects => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:17.561188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.589683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d3a4-5131-4aae-84ba-7a0ccdb251e2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.626837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.627533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.627815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.628095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/2b0c94cc4dbe432d8153b2bd96ed5e97/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.630171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] RBAC: Authorizing `identity:create_grant(project_id=656dd4f282c64dd290d9506d8a1c14e8, user_id=2b0c94cc4dbe432d8153b2bd96ed5e97, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.631687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.661313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 62/126] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:17 2022] PUT /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/2b0c94cc4dbe432d8153b2bd96ed5e97/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:17.661313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.676492 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b564643-e784-4123-bcdc-fc28d6f7c27a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.732643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.733453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.733757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.734020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.735415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.737003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.738986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 65/127] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:17.739789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.806252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.806446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:17.812958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343c0da-5925-4e8a-b812-b450a715c622 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.861311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.862071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.862254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.862518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] PATH_INFO: `/v3/users/b84f3ae2815e4bad977b52e094645fff` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.879025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e066b-6b3a-4229-9d4a-e5b02bec5af1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:17.879518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] RBAC: Authorizing `identity:get_user(user_id=b84f3ae2815e4bad977b52e094645fff)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.880798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.883400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 63/128] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/users/b84f3ae2815e4bad977b52e094645fff => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:17.883400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:17.919241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:17.920423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:17.921020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:17.921534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/bd86b132728e4bdb90e02c8095adc0ff/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:17.924118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] RBAC: Authorizing `identity:create_grant(project_id=656dd4f282c64dd290d9506d8a1c14e8, user_id=bd86b132728e4bdb90e02c8095adc0ff, role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:17.925865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:17.946688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 66/129] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:17 2022] PUT /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/bd86b132728e4bdb90e02c8095adc0ff/roles/d8ac88c62f844b499ed53400465ff365 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:17.948489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:18.003636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26172c-3037-4b6f-8455-2d583a78d8e9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:18.049332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:18.049980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:18.050298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:18.050826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:18.051589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:18.051900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:18.053614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:18.065770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 64/130] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:18.066865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:18.096435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86c104-0e0d-4f95-b73b-52f66281ead2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:18.099332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:18.109579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:18.147124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:18.147817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:18.148102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:18.148383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/bd86b132728e4bdb90e02c8095adc0ff/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:18.150397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] RBAC: Authorizing `identity:create_grant(project_id=656dd4f282c64dd290d9506d8a1c14e8, user_id=bd86b132728e4bdb90e02c8095adc0ff, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:18.152732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:18.184522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 67/131] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:17 2022] PUT /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/bd86b132728e4bdb90e02c8095adc0ff/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:18.184915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:18.203060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014a5e-a2c5-4e0c-b233-f9b4decb22be None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:18.253211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:18.254202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:18.254695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:18.255322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:18.348773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:18.351625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:18.377770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:18.428310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc64d-9848-4a97-9136-7d4c5ef75370 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:18.479109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 65/132] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:18.484786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:18.509982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:18.510643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:18.510927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:18.511206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:18.516159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:18.517778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:18.522537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 68/133] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:18 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:18.528035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:18.613592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:18.650156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e3d40-fa15-4f0f-a183-7aedea1abf2f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:18.685509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:18.706582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:18.707256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:18.707589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:18.708010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:18.710954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:18.712506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:18.714229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 66/134] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:18 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:18.720470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:18.781107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee682-3aea-4066-bbfd-40dba7cc79e5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:18.879399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:18.880044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:18.880335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:18.880612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] PATH_INFO: `/v3/projects/2ddfea93400848cf828bf9661d1c1008` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:18.886037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] RBAC: Authorizing `identity:get_project(project_id=2ddfea93400848cf828bf9661d1c1008)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:18.887531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:18.889051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf4116-ea4a-48bd-810b-c5830b7af304 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:18.889497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 69/135] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:18 2022] GET /identity/v3/projects/2ddfea93400848cf828bf9661d1c1008 => generated 312 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:18.895465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:18.942844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d55c2-3d85-4511-b1f5-76d7721c8977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:18.943472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d55c2-3d85-4511-b1f5-76d7721c8977 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:18.943763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d55c2-3d85-4511-b1f5-76d7721c8977 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:18.944038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d55c2-3d85-4511-b1f5-76d7721c8977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:18.944898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d55c2-3d85-4511-b1f5-76d7721c8977 None admin] RBAC: Adding query filter params (role.id=f033f6b999024d23a84b1b858c130c0a, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=b84f3ae2815e4bad977b52e094645fff) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:18.945210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d55c2-3d85-4511-b1f5-76d7721c8977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:18.947429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d55c2-3d85-4511-b1f5-76d7721c8977 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:18.959680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 67/136] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:18 2022] GET /identity/v3/role_assignments?user.id=b84f3ae2815e4bad977b52e094645fff&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=f033f6b999024d23a84b1b858c130c0a => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:19.050842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25842867-721b-4ca0-b37d-7e4ad8cf3fed None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:19.052422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:19.101592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783cbb8-71b6-403f-a34c-21dc011071c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:19.102674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783cbb8-71b6-403f-a34c-21dc011071c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:19.103157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783cbb8-71b6-403f-a34c-21dc011071c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:19.103642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783cbb8-71b6-403f-a34c-21dc011071c5 None admin] PATH_INFO: `/v3/projects/2ddfea93400848cf828bf9661d1c1008/users/bd86b132728e4bdb90e02c8095adc0ff/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:19.105814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783cbb8-71b6-403f-a34c-21dc011071c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ddfea93400848cf828bf9661d1c1008, user_id=bd86b132728e4bdb90e02c8095adc0ff, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:19.107482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783cbb8-71b6-403f-a34c-21dc011071c5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:19.139986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 70/137] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:18 2022] PUT /identity/v3/projects/2ddfea93400848cf828bf9661d1c1008/users/bd86b132728e4bdb90e02c8095adc0ff/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:18:20.248450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984cbe-ceb7-4dc1-85b7-083eb4669993 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:20.248959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984cbe-ceb7-4dc1-85b7-083eb4669993 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:20.249055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984cbe-ceb7-4dc1-85b7-083eb4669993 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:20.250572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 68/138] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:20.267260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14600240-472a-4981-a55f-0341fc1ea94e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:20.268121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14600240-472a-4981-a55f-0341fc1ea94e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:20.268598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14600240-472a-4981-a55f-0341fc1ea94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:20.293461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-14600240-472a-4981-a55f-0341fc1ea94e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:20.294966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-14600240-472a-4981-a55f-0341fc1ea94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:20.385812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 71/139] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:20.422888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984cbe-ceb7-4dc1-85b7-083eb4669993 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:20.489533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:20.554902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984cbe-ceb7-4dc1-85b7-083eb4669993 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:20.599148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a769c97-dd13-4efa-a2a3-4ff21573a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:20.599815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a769c97-dd13-4efa-a2a3-4ff21573a4ca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:20.600148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a769c97-dd13-4efa-a2a3-4ff21573a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:20.600434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a769c97-dd13-4efa-a2a3-4ff21573a4ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:20.601626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a769c97-dd13-4efa-a2a3-4ff21573a4ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:20.603234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a769c97-dd13-4efa-a2a3-4ff21573a4ca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:20.605014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 69/140] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:20.610734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14600240-472a-4981-a55f-0341fc1ea94e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:20.655868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32bc6b-6b88-4836-88f1-5eeb4b4be156 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:20.656223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32bc6b-6b88-4836-88f1-5eeb4b4be156 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:20.656444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32bc6b-6b88-4836-88f1-5eeb4b4be156 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:20.658184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 70/141] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:20.669530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733ea6-6d2f-4bb5-9e5e-f3cb095cabf0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:20.669832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733ea6-6d2f-4bb5-9e5e-f3cb095cabf0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:20.670109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733ea6-6d2f-4bb5-9e5e-f3cb095cabf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:20.698283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-07733ea6-6d2f-4bb5-9e5e-f3cb095cabf0 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:20.699515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-07733ea6-6d2f-4bb5-9e5e-f3cb095cabf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:20.736005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:20.755837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14600240-472a-4981-a55f-0341fc1ea94e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:20.851991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133cef8-8c5c-4a9d-8eb4-05b18bf8546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:20.853031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133cef8-8c5c-4a9d-8eb4-05b18bf8546e None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:20.853525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133cef8-8c5c-4a9d-8eb4-05b18bf8546e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:20.860405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133cef8-8c5c-4a9d-8eb4-05b18bf8546e None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:20.861416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133cef8-8c5c-4a9d-8eb4-05b18bf8546e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:20.863204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133cef8-8c5c-4a9d-8eb4-05b18bf8546e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:20.913233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 71/142] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:20.952626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 72/143] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:18:20 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:20.952860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07733ea6-6d2f-4bb5-9e5e-f3cb095cabf0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:21.073591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac5bc-e542-45f2-8db9-e3a10c6f7f20 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.074454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac5bc-e542-45f2-8db9-e3a10c6f7f20 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.075134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac5bc-e542-45f2-8db9-e3a10c6f7f20 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.077772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 73/144] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:21.083710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e8cb-599b-4027-99db-18291bc51c59 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.084276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e8cb-599b-4027-99db-18291bc51c59 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.084761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e8cb-599b-4027-99db-18291bc51c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.094496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:21.130737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-77b2e8cb-599b-4027-99db-18291bc51c59 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:21.132362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-77b2e8cb-599b-4027-99db-18291bc51c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:21.222702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07733ea6-6d2f-4bb5-9e5e-f3cb095cabf0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:21.349107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 74/145] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:21.349997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:21.350548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5822-9449-41b1-8b42-324f43325248 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.350844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5822-9449-41b1-8b42-324f43325248 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.350964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.351138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5822-9449-41b1-8b42-324f43325248 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.351998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.352361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.352533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 75/146] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:21.362691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd602-ec12-4303-bd64-49ac6f9d752c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.362973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd602-ec12-4303-bd64-49ac6f9d752c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.363256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd602-ec12-4303-bd64-49ac6f9d752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.371092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:21.377258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:21.378197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:21.379075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 72/147] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:21.386312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:21.405009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5d7dd602-ec12-4303-bd64-49ac6f9d752c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:21.408615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5d7dd602-ec12-4303-bd64-49ac6f9d752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:21.526595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0f024-7696-4661-8aa5-b2de3cb15aef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:21.528675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 76/148] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:21.530342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dd602-ec12-4303-bd64-49ac6f9d752c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:21.538737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:21.540298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:21.574428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:21.575109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.575392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.575669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.599604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:21.606747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:21.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:21.608381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:21.611550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 73/149] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:21.612673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:21.658686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dd602-ec12-4303-bd64-49ac6f9d752c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:21.695247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:21.695882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.696162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.696438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.697172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:21.697513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:21.698915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:21.707884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 77/150] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:21.708739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:21.751534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d327e-5c18-4b8b-b24a-110e142e3ad7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:21.785653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:21.818261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05ced4-99c9-4431-8bde-648e3ce9d3d1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:21.853506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:21.854131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.854430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.854688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.855419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:21.855726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:21.856515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:21.857177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:21.857299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:21.857509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:21.857769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:21.865915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 78/151] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:21.866773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:21.890284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:21.895938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:21.896849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:21.897652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 74/152] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:21.902446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:21.975150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983bd19-b598-4d6c-bb1e-d2f7dcf332c2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:21.989481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:22.036372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:22.044235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18029038-334d-4b77-a831-452b27695013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:22.044896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029038-334d-4b77-a831-452b27695013 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.045190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029038-334d-4b77-a831-452b27695013 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.045506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029038-334d-4b77-a831-452b27695013 None admin] PATH_INFO: `/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.047979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18029038-334d-4b77-a831-452b27695013 None admin] RBAC: Authorizing `identity:get_user(user_id=2b0c94cc4dbe432d8153b2bd96ed5e97)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:22.049498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18029038-334d-4b77-a831-452b27695013 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:22.052350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 79/153] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:21 2022] GET /identity/v3/users/2b0c94cc4dbe432d8153b2bd96ed5e97 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:22.053948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18029038-334d-4b77-a831-452b27695013 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:22.096671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899fa9-12e9-4c29-a260-54bc6b58cbff None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:22.141522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:22.142663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.143170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.143642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.146091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:22.147920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:22.150086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 75/154] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:21 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:22.151077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:22.173355 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18029038-334d-4b77-a831-452b27695013 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:22.208088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931d8c-c9c6-47c3-8ae0-40f0dd0856d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:22.208735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931d8c-c9c6-47c3-8ae0-40f0dd0856d1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.209018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931d8c-c9c6-47c3-8ae0-40f0dd0856d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.209361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931d8c-c9c6-47c3-8ae0-40f0dd0856d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.210184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931d8c-c9c6-47c3-8ae0-40f0dd0856d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:22.210498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931d8c-c9c6-47c3-8ae0-40f0dd0856d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:22.211899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931d8c-c9c6-47c3-8ae0-40f0dd0856d1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:22.225372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 80/155] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:22.225372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90e13-9ad5-435a-8479-cd6a7a25a07c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.225372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90e13-9ad5-435a-8479-cd6a7a25a07c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.225372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90e13-9ad5-435a-8479-cd6a7a25a07c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.225372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 81/156] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:22.225978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d90e13-9ad5-435a-8479-cd6a7a25a07c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:22.299750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:22.303549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899f6ae-ff19-440e-81c0-6558d0271917 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:22.310125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:22.342553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16ecf-d434-4b1c-a0eb-39a74ffdf685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:22.343393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16ecf-d434-4b1c-a0eb-39a74ffdf685 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.343507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16ecf-d434-4b1c-a0eb-39a74ffdf685 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.343735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16ecf-d434-4b1c-a0eb-39a74ffdf685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.360867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d90e13-9ad5-435a-8479-cd6a7a25a07c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:22.396142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:22.397020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.397487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.397898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.436901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16ecf-d434-4b1c-a0eb-39a74ffdf685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:22.438639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16ecf-d434-4b1c-a0eb-39a74ffdf685 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:22.469827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:22.471541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:22.532858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:22.584142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:22.589749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 76/157] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:22.591494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd4ac0-823c-4383-a564-e2bd211acf17 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.592006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd4ac0-823c-4383-a564-e2bd211acf17 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.592915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd4ac0-823c-4383-a564-e2bd211acf17 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.594550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 77/158] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:22.595955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e025ef6-b604-41db-9843-4c69fcefe8ff None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.596432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e025ef6-b604-41db-9843-4c69fcefe8ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.597018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e025ef6-b604-41db-9843-4c69fcefe8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.604318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 82/159] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:22.605185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:22.615943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7e025ef6-b604-41db-9843-4c69fcefe8ff None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:22.617579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7e025ef6-b604-41db-9843-4c69fcefe8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:22.716434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c6f6-8c94-46b8-b51f-012b89740833 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:22.748793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 78/160] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:22.750641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8925cb-72dd-42fe-8214-1ddc1adbd2f7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.751142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8925cb-72dd-42fe-8214-1ddc1adbd2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.751704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8925cb-72dd-42fe-8214-1ddc1adbd2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.761166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:22.761166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.761166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.761166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.761579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:22.761579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:22.761579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 83/161] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:22 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:22.761579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:22.786364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cd8925cb-72dd-42fe-8214-1ddc1adbd2f7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:22.787890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cd8925cb-72dd-42fe-8214-1ddc1adbd2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:22.796640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:22.863094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a82a2-0554-4b07-a0fa-2ef9347440f3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:22.891743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 79/162] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:22.892723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8925cb-72dd-42fe-8214-1ddc1adbd2f7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:22.897683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:22.898342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:22.898626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:22.898903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:22.900076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:22.901559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:22.903257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 84/163] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:22 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:22.904110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:22.975156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:23.045666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8925cb-72dd-42fe-8214-1ddc1adbd2f7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:23.067212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:23.079361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a00f7-96e7-4466-b312-64ce4fd04d3b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:23.088888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:23.089640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:23.089917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:23.090234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:23.093480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:23.095096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:23.096788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 80/164] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:22 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:23.097577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:23.152850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:23.153509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:23.153787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:23.154058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:23.272062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:23.273595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:23.330497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae09c91-31e8-4e30-9a1d-e27fbf45424d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:23.376984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:23.382050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 85/165] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:23.382984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:23.389864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:23.426105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:23.426788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:23.427074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:23.427353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:23.466245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:23.471727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:23.472586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:23.473396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 81/166] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:23.474298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:23.489698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17940-4dbe-46ba-95cd-f4382b1dc211 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:23.554328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:23.554958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:23.555242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:23.555522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:23.556332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=2b0c94cc4dbe432d8153b2bd96ed5e97) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:23.556644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:23.558126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:23.574236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 86/167] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:23 2022] GET /identity/v3/role_assignments?user.id=2b0c94cc4dbe432d8153b2bd96ed5e97&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:23.575087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:23.665857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68064ef-60a0-4bbf-9347-ba123b6ba518 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:23.714462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:23.758808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:23.759484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:23.759992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:23.760797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:23.783303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:23.788373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:23.789239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:23.790143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 82/168] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:23.790803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:23.796747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012bb0-3dd5-4886-9654-94c716d036ec None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:23.851111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:23.851746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:23.852031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:23.852303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:23.853111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] RBAC: Adding query filter params (role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=bd86b132728e4bdb90e02c8095adc0ff) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:23.853446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:23.855045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:23.870531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 87/169] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:23 2022] GET /identity/v3/role_assignments?user.id=bd86b132728e4bdb90e02c8095adc0ff&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=d8ac88c62f844b499ed53400465ff365 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:23.872903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:23.883418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:23.999675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706594-d1fc-4363-9977-e53b2d81198e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.059415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.060089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.060377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.060806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.062790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:24.064430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:24.069303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 83/170] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:23 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:24.069303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:24.099444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287f6e-64e3-438e-9824-9e5225838028 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.152732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:24.172985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.174041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.174568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.175108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.176087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:24.176658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:24.178417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:24.191551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 88/171] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:24.192810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:24.254406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf4933-3e3f-4c48-8674-c05c131a124b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.278083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:24.307209 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.307854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.308140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.308420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.309167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:24.311017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:24.312449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:24.321322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 84/172] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:24.322180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:24.361430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006db33-4278-4c9e-962f-c5093053a4b9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.405072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbce90f-0542-4ccc-bef2-c7f163d1808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.405859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbce90f-0542-4ccc-bef2-c7f163d1808a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.406149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbce90f-0542-4ccc-bef2-c7f163d1808a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.406434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbce90f-0542-4ccc-bef2-c7f163d1808a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.408608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbce90f-0542-4ccc-bef2-c7f163d1808a None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=bd86b132728e4bdb90e02c8095adc0ff) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:24.408608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbce90f-0542-4ccc-bef2-c7f163d1808a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:24.409137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbce90f-0542-4ccc-bef2-c7f163d1808a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:24.418879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 89/173] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:24 2022] GET /identity/v3/role_assignments?user.id=bd86b132728e4bdb90e02c8095adc0ff&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=bd4182637160412da90e2d257ec550ce => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:24.425588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370200e-125a-4808-8bde-b5745c8fb014 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.425905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370200e-125a-4808-8bde-b5745c8fb014 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.426229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370200e-125a-4808-8bde-b5745c8fb014 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.427870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 90/174] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:24.428646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370200e-125a-4808-8bde-b5745c8fb014 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:24.470508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e31cc-1239-462b-950c-aa9f7e4f871b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.509391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215495c-7fe5-4a49-a907-b460f4fb1f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.510153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215495c-7fe5-4a49-a907-b460f4fb1f68 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.510430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215495c-7fe5-4a49-a907-b460f4fb1f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.510709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215495c-7fe5-4a49-a907-b460f4fb1f68 None admin] PATH_INFO: `/v3/users/bd86b132728e4bdb90e02c8095adc0ff` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.511936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215495c-7fe5-4a49-a907-b460f4fb1f68 None admin] RBAC: Authorizing `identity:get_user(user_id=bd86b132728e4bdb90e02c8095adc0ff)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:24.514002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215495c-7fe5-4a49-a907-b460f4fb1f68 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:24.516343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 85/175] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:24 2022] GET /identity/v3/users/bd86b132728e4bdb90e02c8095adc0ff => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:24.517413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e683d-451e-4adb-ab9e-1e347907897f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.517708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e683d-451e-4adb-ab9e-1e347907897f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.518164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e683d-451e-4adb-ab9e-1e347907897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.542209 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ae7e683d-451e-4adb-ab9e-1e347907897f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:24.543572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ae7e683d-451e-4adb-ab9e-1e347907897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:24.564802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:24.597715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:24.651473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 86/176] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:24.652363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e683d-451e-4adb-ab9e-1e347907897f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:24.664430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370200e-125a-4808-8bde-b5745c8fb014 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.712642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.713326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.713617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.713899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] PATH_INFO: `/v3/users/b84f3ae2815e4bad977b52e094645fff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.715101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] RBAC: Authorizing `identity:get_user(user_id=b84f3ae2815e4bad977b52e094645fff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:24.716570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:24.719102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 91/177] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:24 2022] GET /identity/v3/users/b84f3ae2815e4bad977b52e094645fff => generated 289 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:24.721461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:24.793871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e683d-451e-4adb-ab9e-1e347907897f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.829387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d43e-f378-4ffd-876e-02969d15fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.830016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d43e-f378-4ffd-876e-02969d15fa6d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.830297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d43e-f378-4ffd-876e-02969d15fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.830567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d43e-f378-4ffd-876e-02969d15fa6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.836516 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae6c7-59fa-4583-9eb3-ed741a052d24 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:24.856395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:24.871021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a4a22-836d-4909-86bc-21693441e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:24.871667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a4a22-836d-4909-86bc-21693441e104 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.871937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a4a22-836d-4909-86bc-21693441e104 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.872233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a4a22-836d-4909-86bc-21693441e104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.876218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:24.882825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a4a22-836d-4909-86bc-21693441e104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5c2a4a22-836d-4909-86bc-21693441e104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:24.888260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:24.889136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:24.889967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 92/178] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:24.890856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724dbf-c780-45c5-be7b-98127f1cd6ff None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:24.891140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724dbf-c780-45c5-be7b-98127f1cd6ff None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:24.891383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724dbf-c780-45c5-be7b-98127f1cd6ff None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:24.892633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 93/179] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:24.893412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724dbf-c780-45c5-be7b-98127f1cd6ff None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:24.909700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d43e-f378-4ffd-876e-02969d15fa6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:24.911206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d43e-f378-4ffd-876e-02969d15fa6d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:24.996222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724dbf-c780-45c5-be7b-98127f1cd6ff None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.011874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 87/180] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:25.013143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0fad-47d3-4cbe-b791-fe42e1777024 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.013459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0fad-47d3-4cbe-b791-fe42e1777024 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.013742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0fad-47d3-4cbe-b791-fe42e1777024 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.015141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 88/181] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:25.018490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0fad-47d3-4cbe-b791-fe42e1777024 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.031764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba30cf-dbcc-4ec0-8353-0bbb279a439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.032416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba30cf-dbcc-4ec0-8353-0bbb279a439f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.032702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba30cf-dbcc-4ec0-8353-0bbb279a439f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.032984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba30cf-dbcc-4ec0-8353-0bbb279a439f None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.034168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba30cf-dbcc-4ec0-8353-0bbb279a439f None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.035640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba30cf-dbcc-4ec0-8353-0bbb279a439f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.037353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 94/182] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:24 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.038589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f672a9-90cf-45f7-9caa-2a33e5a9b633 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.038880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f672a9-90cf-45f7-9caa-2a33e5a9b633 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.039159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f672a9-90cf-45f7-9caa-2a33e5a9b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.056337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-87f672a9-90cf-45f7-9caa-2a33e5a9b633 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:25.057506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-87f672a9-90cf-45f7-9caa-2a33e5a9b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:25.097140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.100962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.123088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0fad-47d3-4cbe-b791-fe42e1777024 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.123670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 95/183] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:25.124488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f672a9-90cf-45f7-9caa-2a33e5a9b633 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.157850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d87e3-2cbe-4e4b-b1bd-4fbe50eb3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.158466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d87e3-2cbe-4e4b-b1bd-4fbe50eb3f66 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.158742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d87e3-2cbe-4e4b-b1bd-4fbe50eb3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.159018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d87e3-2cbe-4e4b-b1bd-4fbe50eb3f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.159741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d87e3-2cbe-4e4b-b1bd-4fbe50eb3f66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:25.160045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d87e3-2cbe-4e4b-b1bd-4fbe50eb3f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.161493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d87e3-2cbe-4e4b-b1bd-4fbe50eb3f66 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.169421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 89/184] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.172093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbd887-74db-4fae-a381-7b342669a28c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.172422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbd887-74db-4fae-a381-7b342669a28c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.173069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbd887-74db-4fae-a381-7b342669a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.190235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cdfbd887-74db-4fae-a381-7b342669a28c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:25.191427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cdfbd887-74db-4fae-a381-7b342669a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:25.229351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f672a9-90cf-45f7-9caa-2a33e5a9b633 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.258794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 90/185] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:25.262149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbd887-74db-4fae-a381-7b342669a28c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.266940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.267593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.267877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.268153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] PATH_INFO: `/v3/projects/2ddfea93400848cf828bf9661d1c1008` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.269340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] RBAC: Authorizing `identity:get_project(project_id=2ddfea93400848cf828bf9661d1c1008)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.270810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.272626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 96/186] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/projects/2ddfea93400848cf828bf9661d1c1008 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.274818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.322460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.326989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.360989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbd887-74db-4fae-a381-7b342669a28c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.374096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a0405-9810-4a41-a364-cead170619bc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.394590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.395276 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.395554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.395829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/b84f3ae2815e4bad977b52e094645fff/roles/f033f6b999024d23a84b1b858c130c0a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.397778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] RBAC: Authorizing `identity:create_grant(project_id=656dd4f282c64dd290d9506d8a1c14e8, user_id=b84f3ae2815e4bad977b52e094645fff, role_id=f033f6b999024d23a84b1b858c130c0a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.399247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.407591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.408237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.408518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.408796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.411676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 91/187] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:25 2022] PUT /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/users/b84f3ae2815e4bad977b52e094645fff/roles/f033f6b999024d23a84b1b858c130c0a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:25.412473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.420822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:25.426214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:25.427361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:25.428293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 97/188] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:25.433876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.529310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c54f0-cefb-4d69-9023-7479c89884ee None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.546293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a70a9-0043-40d6-ba31-ce4d0aea83b2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.555550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.557801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.572561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.572845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.573134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] PATH_INFO: `/v3/users/06910dbd50684eaf98f1bec561326337` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.590270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] RBAC: Authorizing `identity:get_user(user_id=06910dbd50684eaf98f1bec561326337)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.591868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.592764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.593476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.593826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.594207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.594345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 92/189] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/users/06910dbd50684eaf98f1bec561326337 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.597452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.597612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=2ddfea93400848cf828bf9661d1c1008, user.id=bd86b132728e4bdb90e02c8095adc0ff) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:25.597612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.597612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.606957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 98/190] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/role_assignments?user.id=bd86b132728e4bdb90e02c8095adc0ff&scope.project.id=2ddfea93400848cf828bf9661d1c1008&role.id=bd4182637160412da90e2d257ec550ce => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.607940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.726381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170fe0-e5fc-447e-800f-56098a1344e0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.745763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ace5-4167-4aa8-860f-96e891af4e31 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.767508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.768157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.768444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.768727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.769659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:25.769971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.771774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.785471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 99/191] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.786532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.803638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.804311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.804591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.804979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.806798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.807698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.809644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 93/192] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.810351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:25.827037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.878854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:25.910056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707f70-3bf1-4579-b3a9-d32a29e30155 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.940678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16e95-3be1-48bd-a912-c8d43520a641 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:25.945867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.946509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.946794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.947080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.979859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:25.980516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:25.980798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:25.981161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] PATH_INFO: `/v3/users/06910dbd50684eaf98f1bec561326337` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:25.982444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] RBAC: Authorizing `identity:get_user(user_id=06910dbd50684eaf98f1bec561326337)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:25.983935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:25.990282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 94/193] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/users/06910dbd50684eaf98f1bec561326337 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:25.990282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:26.029888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:26.031491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:26.063406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:26.107378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8fcb-cd0e-4b10-8bb4-782bcc99dc27 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:26.129147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:26.138615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 100/194] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:26.143798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:26.144611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:26.145366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:26.145740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:26.146108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:26.146890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:26.148437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:26.173171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 95/195] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:18:25 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:26.174166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:26.287232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab9290-38a4-453b-aa96-e0717e68bd21 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:26.301199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dbbeb-17f9-4c0f-ad4f-bed94e6f493f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:26.320404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:26.327426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:26.328218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:26.328679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:26.329068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:26.341034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:26.341734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:26.342408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:26.342746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:26.343972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:26.345550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:26.347644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 96/196] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:26 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:26.353548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:26.402675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:26.416565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:26.418215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:26.477146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044580-9df7-47ba-b715-3e5a5c9057fe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:26.514590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:26.515571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:26.516142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:26.516608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:26.517733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=06910dbd50684eaf98f1bec561326337) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:26.518938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:26.520638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:26.530334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 97/197] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:26 2022] GET /identity/v3/role_assignments?user.id=06910dbd50684eaf98f1bec561326337&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:26.553975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 101/198] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:26.560169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:26.681355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6579d-7250-4758-92dd-7a6e21f72b0b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:26.692182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:26.724698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115b1d-c04a-4101-828b-39508cfe7f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:26.725409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115b1d-c04a-4101-828b-39508cfe7f32 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:26.725697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115b1d-c04a-4101-828b-39508cfe7f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:26.725968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115b1d-c04a-4101-828b-39508cfe7f32 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:26.727180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9115b1d-c04a-4101-828b-39508cfe7f32 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:26.728680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9115b1d-c04a-4101-828b-39508cfe7f32 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:26.730763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 98/199] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:26 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:26.737079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:26.770338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:26.847725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c78085-5734-4ffd-a102-2ba16583c620 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:26.894145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593804b-d3e2-4a53-9f6d-a6d58728aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:26.894771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593804b-d3e2-4a53-9f6d-a6d58728aa9c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:26.895051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593804b-d3e2-4a53-9f6d-a6d58728aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:26.895325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593804b-d3e2-4a53-9f6d-a6d58728aa9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:26.896126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593804b-d3e2-4a53-9f6d-a6d58728aa9c None admin] RBAC: Adding query filter params (role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=06910dbd50684eaf98f1bec561326337) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:26.896432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593804b-d3e2-4a53-9f6d-a6d58728aa9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:26.897916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593804b-d3e2-4a53-9f6d-a6d58728aa9c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:26.909694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 102/200] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:26 2022] GET /identity/v3/role_assignments?user.id=06910dbd50684eaf98f1bec561326337&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=d8ac88c62f844b499ed53400465ff365 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:27.541849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0e74c-6855-472e-b271-bf498196b7ec None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:27.542370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0e74c-6855-472e-b271-bf498196b7ec None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:27.542370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0e74c-6855-472e-b271-bf498196b7ec None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:27.544076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 99/201] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:27.549455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313814ff-6a76-4c79-8fbc-fdfa18d284f9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:27.549850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313814ff-6a76-4c79-8fbc-fdfa18d284f9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:27.550020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313814ff-6a76-4c79-8fbc-fdfa18d284f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:27.573410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-313814ff-6a76-4c79-8fbc-fdfa18d284f9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:27.574618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-313814ff-6a76-4c79-8fbc-fdfa18d284f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:27.650857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 103/202] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:27.688856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0e74c-6855-472e-b271-bf498196b7ec None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:27.842877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0e74c-6855-472e-b271-bf498196b7ec None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:27.886740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:27.887680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:27.888097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:27.888506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:27.905059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:27.910942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:27.911981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:27.912942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:27.915268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 100/203] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:27.920919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313814ff-6a76-4c79-8fbc-fdfa18d284f9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:27.966147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:28.052964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313814ff-6a76-4c79-8fbc-fdfa18d284f9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:28.100723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:28.101270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:28.101568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:28.101843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:28.102566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:28.102870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:28.104319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:28.116551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 104/204] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:28.121958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:28.182393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:28.271607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730235-8036-423a-a760-9b70c663d3c2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:28.317906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:28.318569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:28.318899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:28.319179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] PATH_INFO: `/v3/users/b84f3ae2815e4bad977b52e094645fff` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:28.320396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] RBAC: Authorizing `identity:get_user(user_id=b84f3ae2815e4bad977b52e094645fff)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:28.321937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:28.323556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 101/205] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:28 2022] GET /identity/v3/users/b84f3ae2815e4bad977b52e094645fff => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:28.332532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:28.438319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:28.456970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59972b39-9bc4-42e1-8026-a56522139480 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:28.492814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:28.493482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:28.493772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:28.494056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:28.564260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:28.565789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:28.657081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:28.674588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 105/206] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:28.680153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:28.782789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff08e-64b7-40ea-a6ef-851397f01b61 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:28.785105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:28.816494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1988ff5-c5b8-4a1e-a0b1-d11d4f207ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:28.817156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1988ff5-c5b8-4a1e-a0b1-d11d4f207ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:28.817478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1988ff5-c5b8-4a1e-a0b1-d11d4f207ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:28.817824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1988ff5-c5b8-4a1e-a0b1-d11d4f207ab2 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:28.819358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1988ff5-c5b8-4a1e-a0b1-d11d4f207ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:28.820841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1988ff5-c5b8-4a1e-a0b1-d11d4f207ab2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:28.822559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 102/207] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:28 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:28.828673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:28.930660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802a41d-da39-4468-ac21-953fe71fb61c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:28.965735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219629-6eb8-4ba3-b129-31c4cf57c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:28.966375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219629-6eb8-4ba3-b129-31c4cf57c57e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:28.966654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219629-6eb8-4ba3-b129-31c4cf57c57e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:28.967298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219629-6eb8-4ba3-b129-31c4cf57c57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:28.968119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219629-6eb8-4ba3-b129-31c4cf57c57e None admin] RBAC: Adding query filter params (role.id=f033f6b999024d23a84b1b858c130c0a, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8, user.id=b84f3ae2815e4bad977b52e094645fff) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:28.968433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219629-6eb8-4ba3-b129-31c4cf57c57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:28.970080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219629-6eb8-4ba3-b129-31c4cf57c57e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:28.972929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5874-ca12-4584-b85c-ff2f4ca34d8b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:28.973214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5874-ca12-4584-b85c-ff2f4ca34d8b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:28.973517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5874-ca12-4584-b85c-ff2f4ca34d8b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:28.975440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 103/208] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:28.982672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ec606-2d5b-42e7-9671-9adad8edd416 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:28.983582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ec606-2d5b-42e7-9671-9adad8edd416 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:28.984036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ec606-2d5b-42e7-9671-9adad8edd416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:28.993650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 106/209] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:28 2022] GET /identity/v3/role_assignments?user.id=b84f3ae2815e4bad977b52e094645fff&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=f033f6b999024d23a84b1b858c130c0a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:29.019451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ad3ec606-2d5b-42e7-9671-9adad8edd416 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:29.020937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ad3ec606-2d5b-42e7-9671-9adad8edd416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:29.072705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e079-e1ad-4d9c-98c9-4b25ee6ea226 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.073007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e079-e1ad-4d9c-98c9-4b25ee6ea226 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.073187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e079-e1ad-4d9c-98c9-4b25ee6ea226 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.074752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 107/210] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:29.080823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd159df4-66c3-49c7-b044-be13247e9cc8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.081478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd159df4-66c3-49c7-b044-be13247e9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.081957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd159df4-66c3-49c7-b044-be13247e9cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.107494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bd159df4-66c3-49c7-b044-be13247e9cc8 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:29.109871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bd159df4-66c3-49c7-b044-be13247e9cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:29.119223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 104/211] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:29.120604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8095-d1b4-41fb-b595-ca009570e502 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.120896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8095-d1b4-41fb-b595-ca009570e502 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.121166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8095-d1b4-41fb-b595-ca009570e502 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.122494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 105/212] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:29.128162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161deecb-8fc1-4363-a0b2-4ed1eefc6ba8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.128447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161deecb-8fc1-4363-a0b2-4ed1eefc6ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.128723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161deecb-8fc1-4363-a0b2-4ed1eefc6ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.154558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-161deecb-8fc1-4363-a0b2-4ed1eefc6ba8 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:29.155839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-161deecb-8fc1-4363-a0b2-4ed1eefc6ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:29.184572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:29.212346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 108/213] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:29.213237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd159df4-66c3-49c7-b044-be13247e9cc8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.239492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 106/214] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:29.246458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161deecb-8fc1-4363-a0b2-4ed1eefc6ba8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.284200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:29.348212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd159df4-66c3-49c7-b044-be13247e9cc8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.371007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161deecb-8fc1-4363-a0b2-4ed1eefc6ba8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.382850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.383521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.383793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.384067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.396865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:29.403909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:29.405049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:29.405979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 109/215] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:29.406839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.417499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.418464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.418906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.419338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.430695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:29.436366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:29.437413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:29.438349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 107/216] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:29.444731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.453952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:29.511347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68ab88-efe0-4103-a9d4-a2d3a3e762a7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.537976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:29.546193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.546855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.547217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.547495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.547934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61f48-94dc-4c70-a346-ec06a747aa75 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.548728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:29.550228 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:29.551909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 110/217] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:29.552677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.585391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.586210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.586561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.586842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.587564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:29.587869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:29.589512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:29.598997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 108/218] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:29.599780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.656917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c478-b7e0-42dd-96c9-2ec6fd7a73b8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.667735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:29.693596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.694219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.694498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.694774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.695489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:29.695790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:29.697167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:29.702568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915fe76-3e5c-4e42-ac05-dd9caeb75da5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.705465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 111/219] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:29.706019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.739847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954ce3-cd73-4b8a-b04e-d42b20c65130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.740858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954ce3-cd73-4b8a-b04e-d42b20c65130 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.741142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954ce3-cd73-4b8a-b04e-d42b20c65130 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.741450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954ce3-cd73-4b8a-b04e-d42b20c65130 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.742146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba954ce3-cd73-4b8a-b04e-d42b20c65130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:29.743610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba954ce3-cd73-4b8a-b04e-d42b20c65130 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:29.765690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 109/220] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:18:29 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:29.767065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b235c6-f594-444a-9db0-fb115985cbc0 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.767414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b235c6-f594-444a-9db0-fb115985cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b235c6-f594-444a-9db0-fb115985cbc0 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.769107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 110/221] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:29.769858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b235c6-f594-444a-9db0-fb115985cbc0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.791344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:29.830212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d4dfe-3c3d-482f-a379-e1aa8cde6d41 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.869325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a60a52-d423-4f9b-9c76-dd7e7696c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.869895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a60a52-d423-4f9b-9c76-dd7e7696c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.870172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a60a52-d423-4f9b-9c76-dd7e7696c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.870454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a60a52-d423-4f9b-9c76-dd7e7696c6c4 None admin] PATH_INFO: `/v3/users/06910dbd50684eaf98f1bec561326337` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.871659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a60a52-d423-4f9b-9c76-dd7e7696c6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=06910dbd50684eaf98f1bec561326337)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:29.873152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a60a52-d423-4f9b-9c76-dd7e7696c6c4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:29.879742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 112/222] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/users/06910dbd50684eaf98f1bec561326337 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:29.881215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1038e2-7b7b-4b19-9f34-806b0a8a9c82 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.881528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1038e2-7b7b-4b19-9f34-806b0a8a9c82 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.881811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1038e2-7b7b-4b19-9f34-806b0a8a9c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.900573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cf1038e2-7b7b-4b19-9f34-806b0a8a9c82 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:29.901109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b235c6-f594-444a-9db0-fb115985cbc0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:29.901822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cf1038e2-7b7b-4b19-9f34-806b0a8a9c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:29.937711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:29.938973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:29.938973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:29.938973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] PATH_INFO: `/v3/users/50d84f173f8e4a44834e6e60e464558e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:29.940298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:29.955073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] RBAC: Authorizing `identity:get_user(user_id=50d84f173f8e4a44834e6e60e464558e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:29.956582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:29.958397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 111/223] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/users/50d84f173f8e4a44834e6e60e464558e => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:29.959163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:29.984426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 113/224] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:29.985176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1038e2-7b7b-4b19-9f34-806b0a8a9c82 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.041015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:30.092328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74ad08-8cec-435a-a0cf-01f1aa45eaa8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.123116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1038e2-7b7b-4b19-9f34-806b0a8a9c82 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.147169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.148122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.148417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.148691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.150607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:30.152623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:30.155339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 112/225] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:30.156662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.162111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.162764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.163048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.163372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.212976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:30.255842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:30.257614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:30.277052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba52cc-6d99-457b-b450-90b90d4ce81e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.313311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.314000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.314276 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.314553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.317568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:30.326997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:30.332600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:30.333546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:30.334329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 113/226] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:30.335175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.379150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 114/227] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:30.380042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.463319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6954-def7-456b-a07d-0b369f506fa9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.472321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:30.500261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.500946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.501228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.501534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/06910dbd50684eaf98f1bec561326337/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.503507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ac77299c12c4076922faff7ff3815e5, user_id=06910dbd50684eaf98f1bec561326337, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:30.504987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:30.511726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb011535-4f52-481f-9f7d-a0fdd7daefa0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.521861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 114/228] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:30 2022] PUT /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/06910dbd50684eaf98f1bec561326337/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:30.523378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.556339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.557018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.557318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.557641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.558435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:30.558741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:30.560475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:30.570687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 115/229] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:30.577244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.600614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:30.663318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ffa6f-7abc-4b53-95b5-c04d76c24264 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.707418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.708918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.709494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.710170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.711982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:30.713723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:30.715695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 115/230] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:30 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:30.723103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.759161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9d47-13f6-4687-b7e1-45078054e167 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.800646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:30.805820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.806710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.807301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.807697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] PATH_INFO: `/v3/users/06910dbd50684eaf98f1bec561326337` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.809367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] RBAC: Authorizing `identity:get_user(user_id=06910dbd50684eaf98f1bec561326337)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:30.810930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:30.812895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 116/231] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:30 2022] GET /identity/v3/users/06910dbd50684eaf98f1bec561326337 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:30.818774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:30.916727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8e19-f5c5-4669-abad-a172658a572b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.958216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:30.963669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6438c-731d-4c2e-90fd-d902cdbcba2e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:30.982283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:30.982926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:30.983203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:30.983479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:30.984464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=50d84f173f8e4a44834e6e60e464558e) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:30.984872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:30.987162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:30.997513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 116/232] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:30 2022] GET /identity/v3/role_assignments?user.id=50d84f173f8e4a44834e6e60e464558e&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=bd4182637160412da90e2d257ec550ce => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:31.030595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e75b3e-8247-4b3e-b721-60fd68dc5c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:31.031377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75b3e-8247-4b3e-b721-60fd68dc5c1b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:31.031647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75b3e-8247-4b3e-b721-60fd68dc5c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:31.031981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75b3e-8247-4b3e-b721-60fd68dc5c1b None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:31.033364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e75b3e-8247-4b3e-b721-60fd68dc5c1b None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:31.034945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e75b3e-8247-4b3e-b721-60fd68dc5c1b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:31.036841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 117/233] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:30 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:31.042831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:31.171118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5a020-df35-4d53-aca0-95f4a14495e4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:31.208206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e42505-d219-4f3f-87fe-2a17ff49d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:31.208887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42505-d219-4f3f-87fe-2a17ff49d2cb None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:31.209170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42505-d219-4f3f-87fe-2a17ff49d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:31.209475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42505-d219-4f3f-87fe-2a17ff49d2cb None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/06910dbd50684eaf98f1bec561326337/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:31.211716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e42505-d219-4f3f-87fe-2a17ff49d2cb None admin] RBAC: Authorizing `identity:create_grant(project_id=7ac77299c12c4076922faff7ff3815e5, user_id=06910dbd50684eaf98f1bec561326337, role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:31.213200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e42505-d219-4f3f-87fe-2a17ff49d2cb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:31.234119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 117/234] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:31 2022] PUT /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/06910dbd50684eaf98f1bec561326337/roles/d8ac88c62f844b499ed53400465ff365 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:18:32.273712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c43c57-29c5-4a4c-ae3d-87091f58da6f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.274251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c43c57-29c5-4a4c-ae3d-87091f58da6f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.274251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c43c57-29c5-4a4c-ae3d-87091f58da6f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.275853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 118/235] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:32.284325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a44db-2f9e-4dd5-b3c4-37847c692e23 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.284325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a44db-2f9e-4dd5-b3c4-37847c692e23 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.284849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b4b4-be41-463e-8599-0dd5fda6b276 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.284923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a44db-2f9e-4dd5-b3c4-37847c692e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.284991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b4b4-be41-463e-8599-0dd5fda6b276 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.284991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b4b4-be41-463e-8599-0dd5fda6b276 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.286632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 119/236] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:32.291963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87a1c-7290-4a7d-8356-a9add1a494d7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.292475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87a1c-7290-4a7d-8356-a9add1a494d7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.292953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87a1c-7290-4a7d-8356-a9add1a494d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.309410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-285a44db-2f9e-4dd5-b3c4-37847c692e23 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:32.310600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-285a44db-2f9e-4dd5-b3c4-37847c692e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:32.312898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c6a87a1c-7290-4a7d-8356-a9add1a494d7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:32.314310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c6a87a1c-7290-4a7d-8356-a9add1a494d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:32.383545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:32.389888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 120/237] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:32.413324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:32.414712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87a1c-7290-4a7d-8356-a9add1a494d7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:32.472068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 118/238] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:32.515625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a44db-2f9e-4dd5-b3c4-37847c692e23 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:32.523784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87a1c-7290-4a7d-8356-a9add1a494d7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:32.561504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:32.562595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.563080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.563591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.574688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:32.580274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:32.581170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:32.582023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:32.584392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 121/239] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:32.590354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:32.659018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:32.703312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71821f8-04be-41f8-a43b-62ced0ef2641 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:32.743856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:32.744881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.745388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.746166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.747140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:32.747642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:32.749660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:32.758939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 122/240] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:32.764630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:32.835237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a44db-2f9e-4dd5-b3c4-37847c692e23 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:32.879969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c88a-5099-4c1e-bfbf-930da8f06544 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:32.909312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:32.919245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:32.920170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.920612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.922294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] PATH_INFO: `/v3/users/e7556e72001f436ebc7f8b35fe2ad7c5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.944913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:32.946950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:32.948224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:32.948679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:32.950059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:32.951859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:32.954037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] RBAC: Authorizing `identity:get_user(user_id=e7556e72001f436ebc7f8b35fe2ad7c5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:32.954403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 119/241] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:32.955644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:32.957508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 123/242] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:32 2022] GET /identity/v3/users/e7556e72001f436ebc7f8b35fe2ad7c5 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:32.962393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:32.973799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:33.023284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:33.083555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a591-1bd9-4e51-849d-c004850dc898 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:33.125001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7c6af-f498-4449-88aa-27939f2c5ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:33.126157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7c6af-f498-4449-88aa-27939f2c5ead None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.126667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7c6af-f498-4449-88aa-27939f2c5ead None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.127142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7c6af-f498-4449-88aa-27939f2c5ead None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.128211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7c6af-f498-4449-88aa-27939f2c5ead None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:33.130783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7c6af-f498-4449-88aa-27939f2c5ead None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:33.135251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c142-6793-421e-8693-d8c23f276f12 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:33.164779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 120/243] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:18:32 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:18:33.166509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dcee2-be9c-4382-8583-a26d2e7d0cb1 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.166972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dcee2-be9c-4382-8583-a26d2e7d0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.167477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dcee2-be9c-4382-8583-a26d2e7d0cb1 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.169730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 121/244] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:33.183543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedffb24-c254-4443-9894-4083c8d07360 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.183822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedffb24-c254-4443-9894-4083c8d07360 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.184426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedffb24-c254-4443-9894-4083c8d07360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.208493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:33.209148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.209474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.209750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.229529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dedffb24-c254-4443-9894-4083c8d07360 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:33.230885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dedffb24-c254-4443-9894-4083c8d07360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:33.298093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:33.343120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:33.345061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:33.371461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 122/245] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:33.395223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedffb24-c254-4443-9894-4083c8d07360 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:33.433056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:33.480583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 124/246] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 08:18:33.485799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:33.523740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedffb24-c254-4443-9894-4083c8d07360 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:33.571085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f43ee-5ce5-40c1-849c-463be4216760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:33.571748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f43ee-5ce5-40c1-849c-463be4216760 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.572031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f43ee-5ce5-40c1-849c-463be4216760 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.572305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f43ee-5ce5-40c1-849c-463be4216760 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.582139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:33.583777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f43ee-5ce5-40c1-849c-463be4216760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-be7f43ee-5ce5-40c1-849c-463be4216760 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:33.589801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:33.590869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:33.591651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 123/247] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:18:33.592679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd82b-a084-4c98-a9cd-eb20e30d5009 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.593725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd82b-a084-4c98-a9cd-eb20e30d5009 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.593725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd82b-a084-4c98-a9cd-eb20e30d5009 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.594731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 124/248] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:33.600111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4b736-77cc-4e41-b480-0bcad5d9195f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.600431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4b736-77cc-4e41-b480-0bcad5d9195f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.600626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4b736-77cc-4e41-b480-0bcad5d9195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.607975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9afb9d-b261-4942-bd64-8ce0f825553a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:33.620319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-43a4b736-77cc-4e41-b480-0bcad5d9195f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:33.621784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-43a4b736-77cc-4e41-b480-0bcad5d9195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:33.662875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:33.663463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.663748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.664016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.665901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:33.667495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:33.669549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 125/249] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:33 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:33.670603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:33.711897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 125/250] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:33.712870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4b736-77cc-4e41-b480-0bcad5d9195f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:33.760429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:33.799269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0f133-38d2-42d7-8c47-48be7e98680a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:33.842060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:33.842710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.843000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.843290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.844242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:33.844554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:33.845984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:33.854811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4b736-77cc-4e41-b480-0bcad5d9195f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:33.855624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 126/251] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:33.856457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:33.868980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:33.901642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b02a9-bb40-45c0-9c45-a4759d691b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:33.902667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b02a9-bb40-45c0-9c45-a4759d691b6e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.903184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b02a9-bb40-45c0-9c45-a4759d691b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.904119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b02a9-bb40-45c0-9c45-a4759d691b6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.905551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b02a9-bb40-45c0-9c45-a4759d691b6e None admin] RBAC: Adding query filter params (role.id=f033f6b999024d23a84b1b858c130c0a, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=e7556e72001f436ebc7f8b35fe2ad7c5) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:33.906472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b02a9-bb40-45c0-9c45-a4759d691b6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:33.908869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b02a9-bb40-45c0-9c45-a4759d691b6e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:33.916931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 126/252] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:33 2022] GET /identity/v3/role_assignments?user.id=e7556e72001f436ebc7f8b35fe2ad7c5&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=f033f6b999024d23a84b1b858c130c0a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:33.918564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d7de-0715-4190-8baa-bf6e3cb758da None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:33.919054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d7de-0715-4190-8baa-bf6e3cb758da None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:33.919529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d7de-0715-4190-8baa-bf6e3cb758da None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:33.921523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 127/253] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:33.927954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d7de-0715-4190-8baa-bf6e3cb758da None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:34.032436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3644fe-b754-4d21-9b5e-32d1973116b2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:34.074783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16843b-4d90-422a-a0a7-058e8c7e81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:34.075983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16843b-4d90-422a-a0a7-058e8c7e81cb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:34.076469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16843b-4d90-422a-a0a7-058e8c7e81cb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:34.076972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16843b-4d90-422a-a0a7-058e8c7e81cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:34.081120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:34.090295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16843b-4d90-422a-a0a7-058e8c7e81cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ec16843b-4d90-422a-a0a7-058e8c7e81cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:34.098198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:34.099154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:34.099940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:34.103027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 127/254] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:34.104645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024b562-ff04-43bb-8947-31f432bcad68 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:34.105140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024b562-ff04-43bb-8947-31f432bcad68 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:34.105648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024b562-ff04-43bb-8947-31f432bcad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:34.116907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d7de-0715-4190-8baa-bf6e3cb758da None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:34.128591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5024b562-ff04-43bb-8947-31f432bcad68 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:34.130226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5024b562-ff04-43bb-8947-31f432bcad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:34.210201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:34.211214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:34.211520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:34.211948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:34.212416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] PATH_INFO: `/v3/users/06910dbd50684eaf98f1bec561326337` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:34.217315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=06910dbd50684eaf98f1bec561326337)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:34.217315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:34.219401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 128/255] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:33 2022] GET /identity/v3/users/06910dbd50684eaf98f1bec561326337 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:34.220752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:34.224116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 128/256] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:34.225011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024b562-ff04-43bb-8947-31f432bcad68 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:34.341640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248a56-5771-406d-9bef-b7fa23916aa0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:34.385162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:34.385850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:34.386097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:34.386369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:34.387106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:34.387415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:34.393168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:34.411145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 129/257] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:34.411786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:34.462057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:34.482262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024b562-ff04-43bb-8947-31f432bcad68 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:34.524301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:34.524939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:34.525223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:34.525515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:34.599490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:34.603662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:34.605735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:34.659281 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16525fa8-62b0-4c50-a387-9f58c5727aca None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:34.717046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 129/258] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:34.717733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:34.810036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:34.810723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:34.811007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:34.811285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:34.825657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:34.837639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bc1d9-84d8-4532-8433-60ab99d07fbc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:34.848287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:34.853794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:34.854662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:34.855472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 130/259] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:34.857160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:34.934358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:34.958006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:34.958678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:34.958962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:34.959239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] PATH_INFO: `/v3/users/50d84f173f8e4a44834e6e60e464558e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:34.960454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] RBAC: Authorizing `identity:get_user(user_id=50d84f173f8e4a44834e6e60e464558e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:34.961349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deeeaa-b83a-414b-ba34-359bde6a6260 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:34.961941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:34.963882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 130/260] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:34 2022] GET /identity/v3/users/50d84f173f8e4a44834e6e60e464558e => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:34.964660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:35.001162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:35.002637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.003098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.003543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.004932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:35.006949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:35.009102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 131/261] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:34 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:35.010041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:35.121728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a1e4-71b2-43e7-94fb-06a1e2ee2af5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:35.161830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:35.162492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.165208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.165519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.166676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:35.168146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:35.169856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 132/262] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:35 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:35.170617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:35.199750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:35.227974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71661f-8851-421f-b8df-43fb8574643d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:35.268244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:35.269257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.269788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.270253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.271642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:35.272149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:35.273904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:35.284080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 131/263] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:35.285150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:35.317498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:35.402883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e06b-28e6-4b1c-b8fc-058acf8f1ce9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:35.432129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4dec-2ba3-4560-9e86-24d7c565ae6e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:35.443497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:35.444474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.444955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.445451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/50d84f173f8e4a44834e6e60e464558e/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.448155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ac77299c12c4076922faff7ff3815e5, user_id=50d84f173f8e4a44834e6e60e464558e, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:35.449926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:35.468395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 132/264] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:35 2022] PUT /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/50d84f173f8e4a44834e6e60e464558e/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:35.469750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:35.509752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:35.510331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.510608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.510881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.512029 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=06910dbd50684eaf98f1bec561326337) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:35.512339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:35.513964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:35.527049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 133/265] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:35 2022] GET /identity/v3/role_assignments?user.id=06910dbd50684eaf98f1bec561326337&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:35.622414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:35.631956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967d186-f020-433d-9c90-0fba6ac2e782 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:35.686093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788bc99-a2c9-4f3b-a7de-374bfa011b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:35.686819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bc99-a2c9-4f3b-a7de-374bfa011b48 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.687100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bc99-a2c9-4f3b-a7de-374bfa011b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.687428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bc99-a2c9-4f3b-a7de-374bfa011b48 None admin] PATH_INFO: `/v3/users/06910dbd50684eaf98f1bec561326337` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.689547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788bc99-a2c9-4f3b-a7de-374bfa011b48 None admin] RBAC: Authorizing `identity:get_user(user_id=06910dbd50684eaf98f1bec561326337)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:35.691082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788bc99-a2c9-4f3b-a7de-374bfa011b48 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:35.693117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 133/266] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:35 2022] GET /identity/v3/users/06910dbd50684eaf98f1bec561326337 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:35.698715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:35.784261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06231-1a2f-448f-bb09-900ea98fd379 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.784438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06231-1a2f-448f-bb09-900ea98fd379 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.784715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06231-1a2f-448f-bb09-900ea98fd379 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.786159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 134/267] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:35.791935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77c152-01d1-44ff-91bf-128bd00ca2f9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.792222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77c152-01d1-44ff-91bf-128bd00ca2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.792492 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77c152-01d1-44ff-91bf-128bd00ca2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.820337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9d77c152-01d1-44ff-91bf-128bd00ca2f9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:35.821581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9d77c152-01d1-44ff-91bf-128bd00ca2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:35.835521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:35.869455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93749ee5-fc53-4263-adb7-49f3534c43aa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:35.912830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 135/268] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:35.917486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f54794-2e25-45b1-933e-9dfed3ed2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:35.918127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f54794-2e25-45b1-933e-9dfed3ed2d5c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:35.918405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f54794-2e25-45b1-933e-9dfed3ed2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:35.918684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f54794-2e25-45b1-933e-9dfed3ed2d5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:35.948464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77c152-01d1-44ff-91bf-128bd00ca2f9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:35.994343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f54794-2e25-45b1-933e-9dfed3ed2d5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:35.996572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f54794-2e25-45b1-933e-9dfed3ed2d5c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.062972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.075033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77c152-01d1-44ff-91bf-128bd00ca2f9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.113124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bb862-1634-4790-ae50-693e6ed00673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.113870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb862-1634-4790-ae50-693e6ed00673 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.114152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb862-1634-4790-ae50-693e6ed00673 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.114424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb862-1634-4790-ae50-693e6ed00673 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.121665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.126810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bb862-1634-4790-ae50-693e6ed00673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5e1bb862-1634-4790-ae50-693e6ed00673 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:36.131832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:36.132702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:36.133500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 136/269] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:36.134495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6142-1de9-4141-a759-c20df3b0e354 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.134591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6142-1de9-4141-a759-c20df3b0e354 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.134802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6142-1de9-4141-a759-c20df3b0e354 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.136142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 137/270] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:36.141447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f6142-1de9-4141-a759-c20df3b0e354 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.154051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 134/271] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:36.155419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ca2a1-4720-4deb-97ac-8000aafc891b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.155710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ca2a1-4720-4deb-97ac-8000aafc891b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.162959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ca2a1-4720-4deb-97ac-8000aafc891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.182577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2a6ca2a1-4720-4deb-97ac-8000aafc891b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:36.183803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2a6ca2a1-4720-4deb-97ac-8000aafc891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:36.251337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f6142-1de9-4141-a759-c20df3b0e354 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.252577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 135/272] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:36.253540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ca2a1-4720-4deb-97ac-8000aafc891b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.287930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.288702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.289078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.289508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.290332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:36.290736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:36.292295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.302052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 138/273] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:36.303190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.314764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.379887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ca2a1-4720-4deb-97ac-8000aafc891b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.387545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.412033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c1b-8fcf-4715-823c-6aa3385acce6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.414979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.415460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.415737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.416007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.417145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:36.418635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.425345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 136/274] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:36 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:36.425345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.453970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c6f95-a72b-43ea-9058-963ca99d6ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.454623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c6f95-a72b-43ea-9058-963ca99d6ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.454908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c6f95-a72b-43ea-9058-963ca99d6ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.455186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c6f95-a72b-43ea-9058-963ca99d6ef8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.456364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c6f95-a72b-43ea-9058-963ca99d6ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:36.457886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c6f95-a72b-43ea-9058-963ca99d6ef8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.459665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 139/275] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:36.462656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c893f1-e131-4aff-a6a3-1c98ba432d85 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.463159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c893f1-e131-4aff-a6a3-1c98ba432d85 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.463686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c893f1-e131-4aff-a6a3-1c98ba432d85 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.465311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 140/276] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:36.470532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c893f1-e131-4aff-a6a3-1c98ba432d85 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.527515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af43c1-2cc5-472b-9afe-ab07a4d55d74 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.553089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.566023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.566608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.566883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.567152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] PATH_INFO: `/v3/users/96f069d0215d47d898022431e1ffc82d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.577901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c893f1-e131-4aff-a6a3-1c98ba432d85 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.581049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] RBAC: Authorizing `identity:get_user(user_id=96f069d0215d47d898022431e1ffc82d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:36.582572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.584241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 137/277] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:36 2022] GET /identity/v3/users/96f069d0215d47d898022431e1ffc82d => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:36.588489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.612705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba135748-eb22-48ff-82ad-dbbd798bee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.613353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135748-eb22-48ff-82ad-dbbd798bee75 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.613636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135748-eb22-48ff-82ad-dbbd798bee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.614038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135748-eb22-48ff-82ad-dbbd798bee75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.614748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba135748-eb22-48ff-82ad-dbbd798bee75 None admin] RBAC: Adding query filter params (role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=06910dbd50684eaf98f1bec561326337) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:36.615155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba135748-eb22-48ff-82ad-dbbd798bee75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:36.616596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba135748-eb22-48ff-82ad-dbbd798bee75 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.621108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.622967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 141/278] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:36 2022] GET /identity/v3/role_assignments?user.id=06910dbd50684eaf98f1bec561326337&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=d8ac88c62f844b499ed53400465ff365 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:36.630788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970aaa-ed32-475a-ac36-700344f790c6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.632136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970aaa-ed32-475a-ac36-700344f790c6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.632628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970aaa-ed32-475a-ac36-700344f790c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.660682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bd970aaa-ed32-475a-ac36-700344f790c6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:36.662463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bd970aaa-ed32-475a-ac36-700344f790c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:36.708167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b2086-099e-4203-bcdb-ba1690771248 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.752983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.753933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.754219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.754489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.755191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:36.756922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.758354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 142/279] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:36.759507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd970aaa-ed32-475a-ac36-700344f790c6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.790784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 138/280] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:18:36 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:36.798465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:36.866085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.910017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd970aaa-ed32-475a-ac36-700344f790c6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.913760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:36.930680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462fec-b3f2-47a8-a98d-0ad251e6171d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:36.954696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.955336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.955652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.955927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:36.957333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, user.id=96f069d0215d47d898022431e1ffc82d, scope.system=all) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:36.957668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:36.959371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:36.969980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 143/281] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Jul 29 08:18:36 2022] GET /identity/v3/role_assignments?user.id=96f069d0215d47d898022431e1ffc82d&scope.system=all&role.id=bd4182637160412da90e2d257ec550ce => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:36.990367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:36.991516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:36.992033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:36.992522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:37.007529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:37.013635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:37.014569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:37.015440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:37.018403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 139/282] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:37.024878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:37.143562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbeae-d07d-468b-ab64-17abb6a678ae None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:37.182421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:37.183072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:37.183354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:37.183628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:37.184348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:37.184653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:37.186117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:37.189650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:37.199926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 144/283] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:37.205964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:37.321119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06718ae8-e2d7-44c8-bcd1-2539ff6b875f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:37.365694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:37.366351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:37.366634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:37.366913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] PATH_INFO: `/v3/users/e7556e72001f436ebc7f8b35fe2ad7c5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:37.374010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] RBAC: Authorizing `identity:get_user(user_id=e7556e72001f436ebc7f8b35fe2ad7c5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:37.375552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:37.377582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 140/284] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:37 2022] GET /identity/v3/users/e7556e72001f436ebc7f8b35fe2ad7c5 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:37.382923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:37.651407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fdc7f-528d-4ad1-a950-69255aa7ca4b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:37.724344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad3e9d-b417-4eae-9f5b-9ae517fa11e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:37.725012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3e9d-b417-4eae-9f5b-9ae517fa11e6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:37.725308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3e9d-b417-4eae-9f5b-9ae517fa11e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:37.725602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3e9d-b417-4eae-9f5b-9ae517fa11e6 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:37.726803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad3e9d-b417-4eae-9f5b-9ae517fa11e6 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:37.728266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad3e9d-b417-4eae-9f5b-9ae517fa11e6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:37.730340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 145/285] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:37 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:37.735883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:37.755274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:37.860779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e406e-e7de-47bd-9035-8e88467104f3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:37.900755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061461b9-6d75-4d02-a4d4-b53338998d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:37.901532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061461b9-6d75-4d02-a4d4-b53338998d54 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:37.901764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061461b9-6d75-4d02-a4d4-b53338998d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:37.902046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061461b9-6d75-4d02-a4d4-b53338998d54 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/e7556e72001f436ebc7f8b35fe2ad7c5/roles/f033f6b999024d23a84b1b858c130c0a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:37.910080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061461b9-6d75-4d02-a4d4-b53338998d54 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ac77299c12c4076922faff7ff3815e5, user_id=e7556e72001f436ebc7f8b35fe2ad7c5, role_id=f033f6b999024d23a84b1b858c130c0a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:37.911573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061461b9-6d75-4d02-a4d4-b53338998d54 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:37.940838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 141/286] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:18:37 2022] PUT /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5/users/e7556e72001f436ebc7f8b35fe2ad7c5/roles/f033f6b999024d23a84b1b858c130c0a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:37.983869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2289-74ae-4021-9891-7dd9d899236f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:37.984346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2289-74ae-4021-9891-7dd9d899236f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:37.984523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2289-74ae-4021-9891-7dd9d899236f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:37.985956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 146/287] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:37.999383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ada3d-8052-4eef-8087-9d635cf2a2c5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:37.999723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ada3d-8052-4eef-8087-9d635cf2a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:37.999997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ada3d-8052-4eef-8087-9d635cf2a2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:38.022212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f39ada3d-8052-4eef-8087-9d635cf2a2c5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:38.023517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f39ada3d-8052-4eef-8087-9d635cf2a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:38.101935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 142/288] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:38.138891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2289-74ae-4021-9891-7dd9d899236f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:38.216246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:38.260773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2289-74ae-4021-9891-7dd9d899236f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:38.301210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:38.301904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:38.302188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:38.302466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:38.315876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:38.321302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:38.322147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:38.322944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 147/289] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:38.328649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ada3d-8052-4eef-8087-9d635cf2a2c5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:38.337180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:38.446475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ada3d-8052-4eef-8087-9d635cf2a2c5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:38.483475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:38.484058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:38.484337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:38.484613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:38.485359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:38.485664 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:38.487070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:38.496066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 143/290] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:38.501702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:38.629553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ede9-c3b7-40de-bf2f-53a26eb968b0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:38.657053 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:38.668462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:38.669118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:38.669533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:38.669810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] PATH_INFO: `/v3/users/50d84f173f8e4a44834e6e60e464558e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:38.670984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] RBAC: Authorizing `identity:get_user(user_id=50d84f173f8e4a44834e6e60e464558e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:38.672482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:38.674300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 148/291] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:38 2022] GET /identity/v3/users/50d84f173f8e4a44834e6e60e464558e => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:38.682439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:38.762877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:38.798876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241f05-ac1d-4b8e-ba2a-238aa59d2eaf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:38.842270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:38.842927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:38.843207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:38.843520 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:38.932955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:38.934473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:39.006165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:39.042501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 144/292] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:39.047895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:39.189217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ee31-1108-4d50-82b7-868a0682f66f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:39.239538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf0a65-b7cf-44c9-8357-2a063c242cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:39.240250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf0a65-b7cf-44c9-8357-2a063c242cbf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.240537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf0a65-b7cf-44c9-8357-2a063c242cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.240814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf0a65-b7cf-44c9-8357-2a063c242cbf None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.246085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf0a65-b7cf-44c9-8357-2a063c242cbf None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:39.257303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf0a65-b7cf-44c9-8357-2a063c242cbf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:39.257303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 149/293] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:39 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:39.266418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:39.417944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdfdc-bacd-4bfe-b2a4-83ee995a95ed None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:39.421130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bcc6-b646-4049-916b-a397b71f1206 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.421570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bcc6-b646-4049-916b-a397b71f1206 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.421819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bcc6-b646-4049-916b-a397b71f1206 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.427215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 150/294] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:39.428490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea175e-062a-491f-8c47-0403b98d03bc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.428780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea175e-062a-491f-8c47-0403b98d03bc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.429061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea175e-062a-491f-8c47-0403b98d03bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.455051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:39.456019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.456486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.456972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.457998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=50d84f173f8e4a44834e6e60e464558e) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:39.458494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:39.460130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:39.467128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 145/295] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:39 2022] GET /identity/v3/role_assignments?user.id=50d84f173f8e4a44834e6e60e464558e&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=bd4182637160412da90e2d257ec550ce => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:39.467906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2bea175e-062a-491f-8c47-0403b98d03bc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:39.469185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2bea175e-062a-491f-8c47-0403b98d03bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:39.558696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:39.577314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 151/296] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 29 08:18:39.610951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:39.648953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b965ce4-1601-448e-9541-90172b1ebcf4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.649623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b965ce4-1601-448e-9541-90172b1ebcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.650095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b965ce4-1601-448e-9541-90172b1ebcf4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.652027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 152/297] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:39.657751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a033004-e679-4d17-9eac-758f5bdbd486 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.658781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a033004-e679-4d17-9eac-758f5bdbd486 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.659272 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a033004-e679-4d17-9eac-758f5bdbd486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.680280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8a033004-e679-4d17-9eac-758f5bdbd486 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:39.681830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8a033004-e679-4d17-9eac-758f5bdbd486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:39.699219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:39.760996 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199a95-bb86-48c9-8ca5-2f02cef93979 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:39.770755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 153/298] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:39.772333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09682e92-852b-42cb-930d-e6b32465af2f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09682e92-852b-42cb-930d-e6b32465af2f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.772963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09682e92-852b-42cb-930d-e6b32465af2f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.774562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 154/299] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:39.779814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13435-7196-47b4-9eaf-b6e63fd9439a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.780114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13435-7196-47b4-9eaf-b6e63fd9439a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.780398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13435-7196-47b4-9eaf-b6e63fd9439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.799449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-34f13435-7196-47b4-9eaf-b6e63fd9439a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:39.800433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:39.800937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-34f13435-7196-47b4-9eaf-b6e63fd9439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:39.801750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.802167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.802573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.814436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:39.821434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:39.822437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:39.823405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:39.825869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 146/300] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:39.826935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:39.872307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 155/301] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:39.881473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13435-7196-47b4-9eaf-b6e63fd9439a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:39.932697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:39.933353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:39.946475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291f10c-ad11-4f05-a134-0dd11cfd9308 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:39.983885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:39.984534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:39.984830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:39.985108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:39.987031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:39.988596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:39.989502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13435-7196-47b4-9eaf-b6e63fd9439a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:39.995024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 147/302] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:39.995024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.037017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.038058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.038594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.039078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.039881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:40.040191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:40.041902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:40.055971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 156/303] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:40.056838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.095625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99db5c-3cf0-4916-87a4-fd91d32bd7fb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.129475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.130126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.130408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.130683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.143257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:40.148718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:40.149832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:40.150611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:40.154806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 148/304] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:40.155505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.164102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b076-7b2b-4cb5-8bda-9086777f3b7d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.178328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:40.178763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:40.200345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.200899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.201186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.201493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] PATH_INFO: `/v3/groups` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.202160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:40.203672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:40.222692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 157/305] 10.222.0.47 () {60 vars in 1134 bytes} [Fri Jul 29 08:18:40 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:40.223826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.290698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820303-3281-4cc3-b898-6fabfcc9d284 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.336926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.338138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.338419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.338697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] PATH_INFO: `/v3/users/96f069d0215d47d898022431e1ffc82d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.340227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] RBAC: Authorizing `identity:get_user(user_id=96f069d0215d47d898022431e1ffc82d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:40.343106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:40.344927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 149/306] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:40 2022] GET /identity/v3/users/96f069d0215d47d898022431e1ffc82d => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:40.350667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.364235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c88e7d-fb73-4f26-bea2-e14fac9fd1e0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.402235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cf1e6-0c99-4bc6-bce4-0b4fd901f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.403158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cf1e6-0c99-4bc6-bce4-0b4fd901f216 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.403584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cf1e6-0c99-4bc6-bce4-0b4fd901f216 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.404011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cf1e6-0c99-4bc6-bce4-0b4fd901f216 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.405591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cf1e6-0c99-4bc6-bce4-0b4fd901f216 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:40.405981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cf1e6-0c99-4bc6-bce4-0b4fd901f216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:40.407399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cf1e6-0c99-4bc6-bce4-0b4fd901f216 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:40.421351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 158/307] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:40.421351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1215-5a01-4602-b3e0-4526769db8b0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.421351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1215-5a01-4602-b3e0-4526769db8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.421351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1215-5a01-4602-b3e0-4526769db8b0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.421351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 159/308] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:40.422891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1215-5a01-4602-b3e0-4526769db8b0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.454798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:40.463033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:40.473777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32a50f-9c7f-46f5-9202-2c3b2a7e3dbc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.508171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d504dd2-44c6-4f80-9947-a4275c0cd83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.508841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d504dd2-44c6-4f80-9947-a4275c0cd83f None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.509125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d504dd2-44c6-4f80-9947-a4275c0cd83f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.509433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d504dd2-44c6-4f80-9947-a4275c0cd83f None admin] PATH_INFO: `/v3/system/users/96f069d0215d47d898022431e1ffc82d/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.510883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d504dd2-44c6-4f80-9947-a4275c0cd83f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=96f069d0215d47d898022431e1ffc82d, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:40.512337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d504dd2-44c6-4f80-9947-a4275c0cd83f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:40.523115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 150/309] 10.222.0.47 () {58 vars in 1334 bytes} [Fri Jul 29 08:18:40 2022] PUT /identity/v3/system/users/96f069d0215d47d898022431e1ffc82d/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:40.526686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752ced4-c58b-46ff-ac21-21c7a3f7338a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.526970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752ced4-c58b-46ff-ac21-21c7a3f7338a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.527254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752ced4-c58b-46ff-ac21-21c7a3f7338a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.557014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3752ced4-c58b-46ff-ac21-21c7a3f7338a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:40.558383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3752ced4-c58b-46ff-ac21-21c7a3f7338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:40.564494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1215-5a01-4602-b3e0-4526769db8b0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.616381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.617696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.618441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.618917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] PATH_INFO: `/v3/users/b574479da4914ce49740db6327508ec4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.638976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 151/310] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:40.639305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] RBAC: Authorizing `identity:get_user(user_id=b574479da4914ce49740db6327508ec4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:40.640897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:40.647649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 160/311] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:40 2022] GET /identity/v3/users/b574479da4914ce49740db6327508ec4 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:40.648959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752ced4-c58b-46ff-ac21-21c7a3f7338a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.661674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.760143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:40.783894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752ced4-c58b-46ff-ac21-21c7a3f7338a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.784639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:40.797927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67726a-905f-48b0-89b5-fe1bcf53c432 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:40.822635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.823259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.823539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.823809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.824597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] RBAC: Adding query filter params (role.id=f033f6b999024d23a84b1b858c130c0a, user.id=b574479da4914ce49740db6327508ec4, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:40.824903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:40.826407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:40.832188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 152/312] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Jul 29 08:18:40 2022] GET /identity/v3/role_assignments?user.id=b574479da4914ce49740db6327508ec4&scope.system=all&role.id=f033f6b999024d23a84b1b858c130c0a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:40.846958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:40.848002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:40.848431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:40.848882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:40.862652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:40.868193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:40.869379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:40.870196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:40.870795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 161/313] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:18:40.877501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:40.989872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b28444-3f5f-4374-a59e-9585e0d03ea4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:41.026361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:41.026929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:41.027207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:41.027475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:41.028199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:41.028498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:41.029902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:41.039005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 153/314] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:41.046763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:41.149187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127403c-ba23-48b0-b9f0-c9e17218a165 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:41.183672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:41.184321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:41.184600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:41.184914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] PATH_INFO: `/v3/users/e7556e72001f436ebc7f8b35fe2ad7c5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:41.186042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] RBAC: Authorizing `identity:get_user(user_id=e7556e72001f436ebc7f8b35fe2ad7c5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:41.187552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:41.189483 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 162/315] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:41 2022] GET /identity/v3/users/e7556e72001f436ebc7f8b35fe2ad7c5 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:41.196494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:41.213651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:41.300959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24313274-37a8-48b8-ae53-e4b130265540 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:41.335369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:41.335998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:41.336283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:41.336555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:41.406462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:41.408040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:41.418974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:41.508887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 154/316] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:41.514500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:41.536160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:41.616561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671e3f9-7f94-4a52-864e-ff153f25498c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:41.651630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc332bfd-3a1c-4c98-8b1e-9379f75f4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:41.652280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332bfd-3a1c-4c98-8b1e-9379f75f4919 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:41.652563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332bfd-3a1c-4c98-8b1e-9379f75f4919 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:41.652879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332bfd-3a1c-4c98-8b1e-9379f75f4919 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:41.654065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc332bfd-3a1c-4c98-8b1e-9379f75f4919 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:41.655595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc332bfd-3a1c-4c98-8b1e-9379f75f4919 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:41.657603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 163/317] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:41 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:41.663182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:41.765348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1112f5-1363-420d-9aba-8de81122c0a3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:41.774854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:41.800231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf6f71-44b0-488d-b5fb-21ca1fa4bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:41.800919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf6f71-44b0-488d-b5fb-21ca1fa4bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:41.801206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf6f71-44b0-488d-b5fb-21ca1fa4bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:41.801506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf6f71-44b0-488d-b5fb-21ca1fa4bbcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:41.802307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf6f71-44b0-488d-b5fb-21ca1fa4bbcf None admin] RBAC: Adding query filter params (role.id=f033f6b999024d23a84b1b858c130c0a, scope.project.id=7ac77299c12c4076922faff7ff3815e5, user.id=e7556e72001f436ebc7f8b35fe2ad7c5) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:41.802616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf6f71-44b0-488d-b5fb-21ca1fa4bbcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:41.804088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf6f71-44b0-488d-b5fb-21ca1fa4bbcf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:41.810418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 155/318] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:18:41 2022] GET /identity/v3/role_assignments?user.id=e7556e72001f436ebc7f8b35fe2ad7c5&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=f033f6b999024d23a84b1b858c130c0a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:42.306450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54229391-a823-48b8-855a-9a021e03d25e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.306991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54229391-a823-48b8-855a-9a021e03d25e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.306991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54229391-a823-48b8-855a-9a021e03d25e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.308521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 164/319] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:42.313729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6318bd-3d30-4708-95bd-e55fe68bc716 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.314143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6318bd-3d30-4708-95bd-e55fe68bc716 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.314308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6318bd-3d30-4708-95bd-e55fe68bc716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.333008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ec6318bd-3d30-4708-95bd-e55fe68bc716 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:42.334229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ec6318bd-3d30-4708-95bd-e55fe68bc716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:42.405364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 156/320] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:42.427518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54229391-a823-48b8-855a-9a021e03d25e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:42.522799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:42.537500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54229391-a823-48b8-855a-9a021e03d25e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:42.571953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6568f46-dc0a-44de-886f-e4caa28397a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:42.572686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568f46-dc0a-44de-886f-e4caa28397a5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.572968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568f46-dc0a-44de-886f-e4caa28397a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.573250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568f46-dc0a-44de-886f-e4caa28397a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.574420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6568f46-dc0a-44de-886f-e4caa28397a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:42.575871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6568f46-dc0a-44de-886f-e4caa28397a5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:42.577719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 165/321] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:18:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:42.583158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6318bd-3d30-4708-95bd-e55fe68bc716 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:42.624788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954137c2-ccfa-4864-8f83-3f277876bc13 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.625122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954137c2-ccfa-4864-8f83-3f277876bc13 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.625357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954137c2-ccfa-4864-8f83-3f277876bc13 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.626877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 166/322] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:42.631721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929fc2-2a3e-4a78-a571-647c255c9113 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.631986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929fc2-2a3e-4a78-a571-647c255c9113 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.632259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929fc2-2a3e-4a78-a571-647c255c9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.650317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-15929fc2-2a3e-4a78-a571-647c255c9113 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:42.651504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-15929fc2-2a3e-4a78-a571-647c255c9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:42.686213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6318bd-3d30-4708-95bd-e55fe68bc716 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:42.687848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:42.724146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 167/323] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:42.724831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff6b5c-759e-46a7-9481-9d3c8a96c488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:42.725661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6b5c-759e-46a7-9481-9d3c8a96c488 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.726095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6b5c-759e-46a7-9481-9d3c8a96c488 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.726499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6b5c-759e-46a7-9481-9d3c8a96c488 None admin] PATH_INFO: `/v3/groups` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.727308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff6b5c-759e-46a7-9481-9d3c8a96c488 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:42.728885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff6b5c-759e-46a7-9481-9d3c8a96c488 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:42.746535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 157/324] 10.222.0.47 () {60 vars in 1134 bytes} [Fri Jul 29 08:18:42 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:18:42.747804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15929fc2-2a3e-4a78-a571-647c255c9113 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:42.846145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:42.862931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628904b4-e57b-46d8-a9ff-6ab717ed7d4f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.863511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628904b4-e57b-46d8-a9ff-6ab717ed7d4f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.863962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628904b4-e57b-46d8-a9ff-6ab717ed7d4f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.864828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15929fc2-2a3e-4a78-a571-647c255c9113 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:42.865819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 158/325] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:42.872117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46392ce-39f7-4023-8cba-4555dc3376f4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.872411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46392ce-39f7-4023-8cba-4555dc3376f4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.872678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46392ce-39f7-4023-8cba-4555dc3376f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.894619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d46392ce-39f7-4023-8cba-4555dc3376f4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:42.896902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d46392ce-39f7-4023-8cba-4555dc3376f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:42.908119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:42.908839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:42.909127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:42.909443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:42.921336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:42.926382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:42.927256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:42.928050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 168/326] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:42.933524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:42.989305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 159/327] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:43.005273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46392ce-39f7-4023-8cba-4555dc3376f4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:43.051975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167862-1561-47ce-a133-b07aaf9b2305 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:43.097165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:43.097797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:43.098083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:43.098366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:43.099106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:43.099419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:43.100998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:43.111128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 169/328] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:43.117915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:43.118532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:43.133105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:43.134657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46392ce-39f7-4023-8cba-4555dc3376f4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:43.184443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:43.185121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:43.185463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:43.185744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:43.200587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:43.205838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:43.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:43.207499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 160/329] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:43.212909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:43.262752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd74d2-698b-43e9-b6ad-17f0fbb844b9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:43.309332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:43.310890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:43.311510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:43.312005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] PATH_INFO: `/v3/users/96f069d0215d47d898022431e1ffc82d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:43.315023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] RBAC: Authorizing `identity:get_user(user_id=96f069d0215d47d898022431e1ffc82d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:43.318140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:43.320455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 170/330] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:43 2022] GET /identity/v3/users/96f069d0215d47d898022431e1ffc82d => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:43.328020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:43.359395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0c8b-3374-48c5-9932-c5558e75e7a4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:43.402692 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:43.405263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:43.405671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:43.405954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:43.406799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:43.407210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:43.408748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:43.419369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 161/331] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:43.426753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:43.432676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:43.449560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:43.477532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f9b8f-0616-4d10-a302-0508af0f3704 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:43.519949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:43.520683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:43.521070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:43.521385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:43.522199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] RBAC: Adding query filter params (role.id=bd4182637160412da90e2d257ec550ce, user.id=96f069d0215d47d898022431e1ffc82d, scope.system=all) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:43.522513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:43.523979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:43.545450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 171/332] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Jul 29 08:18:43 2022] GET /identity/v3/role_assignments?user.id=96f069d0215d47d898022431e1ffc82d&scope.system=all&role.id=bd4182637160412da90e2d257ec550ce => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:43.552633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006d6a1-fbbd-4869-a75f-b3bbe3014d28 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:43.592071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3a140-0ca4-40aa-8b86-15a1237e7eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:43.592713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a140-0ca4-40aa-8b86-15a1237e7eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:43.593069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a140-0ca4-40aa-8b86-15a1237e7eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:43.593499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a140-0ca4-40aa-8b86-15a1237e7eb0 None admin] PATH_INFO: `/v3/users/b574479da4914ce49740db6327508ec4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:43.594612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3a140-0ca4-40aa-8b86-15a1237e7eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=b574479da4914ce49740db6327508ec4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:43.596115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3a140-0ca4-40aa-8b86-15a1237e7eb0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:43.598210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 162/333] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:43 2022] GET /identity/v3/users/b574479da4914ce49740db6327508ec4 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:43.604186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:43.733242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3a45d-002e-4d72-9c44-8cce3a56b135 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:43.772981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e19195-cc7c-4dd9-899e-d88e01d5b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:43.773758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e19195-cc7c-4dd9-899e-d88e01d5b9fc None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:43.773998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e19195-cc7c-4dd9-899e-d88e01d5b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:43.774284 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e19195-cc7c-4dd9-899e-d88e01d5b9fc None admin] PATH_INFO: `/v3/system/users/b574479da4914ce49740db6327508ec4/roles/f033f6b999024d23a84b1b858c130c0a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:43.775819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e19195-cc7c-4dd9-899e-d88e01d5b9fc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b574479da4914ce49740db6327508ec4, role_id=f033f6b999024d23a84b1b858c130c0a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:43.777228 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e19195-cc7c-4dd9-899e-d88e01d5b9fc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:43.778989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:43.801043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 172/334] 10.222.0.47 () {58 vars in 1334 bytes} [Fri Jul 29 08:18:43 2022] PUT /identity/v3/system/users/b574479da4914ce49740db6327508ec4/roles/f033f6b999024d23a84b1b858c130c0a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:45.250930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729d0e-611d-4fc0-bcb3-b28f98a7586e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:45.252535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729d0e-611d-4fc0-bcb3-b28f98a7586e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:45.253033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729d0e-611d-4fc0-bcb3-b28f98a7586e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:45.254894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 163/335] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:45.260706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15732c-c6b5-49af-97a7-eb15cab0650d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:45.261556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15732c-c6b5-49af-97a7-eb15cab0650d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:45.262039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15732c-c6b5-49af-97a7-eb15cab0650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:45.284802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3d15732c-c6b5-49af-97a7-eb15cab0650d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:45.286434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d15732c-c6b5-49af-97a7-eb15cab0650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:45.379314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 173/336] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:45.412665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729d0e-611d-4fc0-bcb3-b28f98a7586e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:45.495511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a896e-6de4-44ac-bac1-1e92bf985335 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:45.496145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a896e-6de4-44ac-bac1-1e92bf985335 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:45.496642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a896e-6de4-44ac-bac1-1e92bf985335 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:45.498314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 174/337] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:45.503864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608420b-1e52-4cfe-a4de-f1b98b726ec5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:45.504401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608420b-1e52-4cfe-a4de-f1b98b726ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:45.504888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608420b-1e52-4cfe-a4de-f1b98b726ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:45.539387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6608420b-1e52-4cfe-a4de-f1b98b726ec5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:45.540904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6608420b-1e52-4cfe-a4de-f1b98b726ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:45.545655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:45.572023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729d0e-611d-4fc0-bcb3-b28f98a7586e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:45.636686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:45.637388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:45.637673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:45.637953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:45.661896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:45.668336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:45.669229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:45.670069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:45.671265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 164/338] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:45.677596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:45.701372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 175/339] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:45.740876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608420b-1e52-4cfe-a4de-f1b98b726ec5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:45.831644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d61865-3c60-4d3e-a5ef-975bc3d13885 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:45.882940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffe9b3-540b-46a1-a65b-9e52fdd1c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:45.883835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe9b3-540b-46a1-a65b-9e52fdd1c5ec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:45.884259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe9b3-540b-46a1-a65b-9e52fdd1c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:45.884670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe9b3-540b-46a1-a65b-9e52fdd1c5ec None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:45.885592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe9b3-540b-46a1-a65b-9e52fdd1c5ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:45.886035 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe9b3-540b-46a1-a65b-9e52fdd1c5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:45.887584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe9b3-540b-46a1-a65b-9e52fdd1c5ec None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:45.888104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:45.897188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 165/340] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:45.898530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1cdb-930d-48ac-af00-33d0ae2704c6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:45.898820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1cdb-930d-48ac-af00-33d0ae2704c6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:45.899099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1cdb-930d-48ac-af00-33d0ae2704c6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:45.900511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 166/341] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:45.906313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1cdb-930d-48ac-af00-33d0ae2704c6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:45.925638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:45.978575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608420b-1e52-4cfe-a4de-f1b98b726ec5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:46.064731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce5cec-7897-4a79-bd4c-ab30b1de9aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:46.065662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5cec-7897-4a79-bd4c-ab30b1de9aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.066083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5cec-7897-4a79-bd4c-ab30b1de9aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.066520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5cec-7897-4a79-bd4c-ab30b1de9aa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.086924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce5cec-7897-4a79-bd4c-ab30b1de9aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-28ce5cec-7897-4a79-bd4c-ab30b1de9aa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:46.092336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:46.093232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:46.094054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:46.094646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1cdb-930d-48ac-af00-33d0ae2704c6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:46.106304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 176/342] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:46.107413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4200dd-95ed-426c-8b59-a518234b23ed None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.107700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4200dd-95ed-426c-8b59-a518234b23ed None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.107979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4200dd-95ed-426c-8b59-a518234b23ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.145180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e4200dd-95ed-426c-8b59-a518234b23ed None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:46.146409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e4200dd-95ed-426c-8b59-a518234b23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:46.154838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:46.155530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.155814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.156088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.281401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:46.283181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:46.284169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 177/343] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:46.285542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4200dd-95ed-426c-8b59-a518234b23ed None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:46.290324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:46.387555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:46.498082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4200dd-95ed-426c-8b59-a518234b23ed None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:46.509569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 167/344] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:46.510511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:46.552682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:46.553853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.554373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.554876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.556043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:46.556544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:46.558719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:46.569433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 178/345] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:46.570564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:46.677686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de451-ad3e-4426-9035-689ece8d48ef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:46.683148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:46.712218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c588b9a-b34d-4f9f-96f8-753b9f5773a6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:46.725851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:46.754100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:46.755128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.755550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.755964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.759179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:46.760006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:46.760782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.761116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:46.761225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.761610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.764254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 179/346] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:46 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:46.765275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:46.790247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:46.796617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:46.797655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:46.798474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:46.799309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 168/347] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:46.800277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:46.894867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f89e9f-b767-4820-906a-19b56291b06d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:46.928912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8e84f-9402-48e9-a6f9-1b52aa7a5a2b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:46.930786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:46.931583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.932009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.932426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.968470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bae524-130f-4042-a026-fed600c1bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:46.969458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bae524-130f-4042-a026-fed600c1bb1a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.969877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bae524-130f-4042-a026-fed600c1bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.970320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bae524-130f-4042-a026-fed600c1bb1a None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.977397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bae524-130f-4042-a026-fed600c1bb1a None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:46.979226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bae524-130f-4042-a026-fed600c1bb1a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:46.981273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 169/348] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:46 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:46.981959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:46.984080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ffca-d46a-4d70-a805-1242f65fbc79 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:46.984514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ffca-d46a-4d70-a805-1242f65fbc79 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:46.984951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ffca-d46a-4d70-a805-1242f65fbc79 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:46.986626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 170/349] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:46.987558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460ffca-d46a-4d70-a805-1242f65fbc79 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.010261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:47.011967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:47.018856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:47.105061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460ffca-d46a-4d70-a805-1242f65fbc79 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:47.131974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 180/350] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:47.133469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.146603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6bdbe-8aca-4c91-9575-919fb0c3d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:47.148538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6bdbe-8aca-4c91-9575-919fb0c3d3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.148538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6bdbe-8aca-4c91-9575-919fb0c3d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.148538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6bdbe-8aca-4c91-9575-919fb0c3d3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.148538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6bdbe-8aca-4c91-9575-919fb0c3d3b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:47.148829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6bdbe-8aca-4c91-9575-919fb0c3d3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:47.150393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6bdbe-8aca-4c91-9575-919fb0c3d3b4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:47.161248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 171/351] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:47.162642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d4888-2c83-4a99-87e1-61bc4e92b6cf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.162939 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d4888-2c83-4a99-87e1-61bc4e92b6cf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.163212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d4888-2c83-4a99-87e1-61bc4e92b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.185901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5b3d4888-2c83-4a99-87e1-61bc4e92b6cf None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:47.187336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5b3d4888-2c83-4a99-87e1-61bc4e92b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:47.240905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:47.267266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad647e-3a1b-45a2-85ca-ac93709c5cce None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:47.280661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 172/352] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:47.282050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2566-c947-4b05-b5df-949b35938200 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.282599 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2566-c947-4b05-b5df-949b35938200 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.282599 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2566-c947-4b05-b5df-949b35938200 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.284113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 173/353] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:47.284934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2566-c947-4b05-b5df-949b35938200 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.313697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:47.315674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:47.316321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.316608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.316888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.317819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:47.318051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:47.320343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:47.326543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 181/354] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:47 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=d8ac88c62f844b499ed53400465ff365 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:47.327416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.433222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2566-c947-4b05-b5df-949b35938200 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:47.447675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bb93-4d30-408b-81e5-98cf91541457 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:47.484082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd488bc-5ac2-4d9a-8886-9937019dd639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:47.485388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd488bc-5ac2-4d9a-8886-9937019dd639 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.485980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd488bc-5ac2-4d9a-8886-9937019dd639 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.486427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:47.486676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd488bc-5ac2-4d9a-8886-9937019dd639 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.487070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.487356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.487637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.488799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd488bc-5ac2-4d9a-8886-9937019dd639 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:47.490743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd488bc-5ac2-4d9a-8886-9937019dd639 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:47.493886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 174/355] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:47 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:47.495395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5c1db-c382-45ab-a6c1-77c4810e05ae None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.495913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5c1db-c382-45ab-a6c1-77c4810e05ae None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.496401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5c1db-c382-45ab-a6c1-77c4810e05ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.507603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:47.519690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b5c5c1db-c382-45ab-a6c1-77c4810e05ae None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:47.521313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b5c5c1db-c382-45ab-a6c1-77c4810e05ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:47.567296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:47.568775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:47.602306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 175/356] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:47.602306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5c1db-c382-45ab-a6c1-77c4810e05ae None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.623523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:47.716005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 182/357] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:47.717029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.721295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5c1db-c382-45ab-a6c1-77c4810e05ae None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:47.759869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9aa23-ac4b-42bc-bb46-bc3a0a73d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:47.761438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9aa23-ac4b-42bc-bb46-bc3a0a73d05c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.761948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9aa23-ac4b-42bc-bb46-bc3a0a73d05c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.762401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9aa23-ac4b-42bc-bb46-bc3a0a73d05c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.773955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:47.778321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9aa23-ac4b-42bc-bb46-bc3a0a73d05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e9b9aa23-ac4b-42bc-bb46-bc3a0a73d05c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:47.783666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:47.784536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:47.785404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 176/358] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:47.786816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bef60-fa18-4ddb-91ea-c7534d06388f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.786816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bef60-fa18-4ddb-91ea-c7534d06388f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.786981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bef60-fa18-4ddb-91ea-c7534d06388f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.788310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 177/359] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:47.788861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bef60-fa18-4ddb-91ea-c7534d06388f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.850337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0da1-186e-4e6f-8ba8-da89b612cf0a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:47.892164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:47.896500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:47.897177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.897515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.897799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.898984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:47.900549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:47.902367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 183/360] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:47 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:47.903500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:47.924147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bef60-fa18-4ddb-91ea-c7534d06388f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:47.971211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960b1dc-5346-4dbe-a6da-946b299054d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:47.971791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960b1dc-5346-4dbe-a6da-946b299054d3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.972076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960b1dc-5346-4dbe-a6da-946b299054d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.972357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960b1dc-5346-4dbe-a6da-946b299054d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:47.984484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960b1dc-5346-4dbe-a6da-946b299054d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a960b1dc-5346-4dbe-a6da-946b299054d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:47.991925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:47.992840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 178/361] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:47.993694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8932354-e9eb-47bc-84a3-0449cfdf3e5c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:47.994403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8932354-e9eb-47bc-84a3-0449cfdf3e5c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:47.994403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8932354-e9eb-47bc-84a3-0449cfdf3e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.015464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b8932354-e9eb-47bc-84a3-0449cfdf3e5c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:48.017125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b8932354-e9eb-47bc-84a3-0449cfdf3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:48.040833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea53df-d57f-4004-af8f-623fbc402851 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.056866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.088862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.089574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.089868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.090137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.091783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.093407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.095033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 184/362] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:47 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:48.096111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.107743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 179/363] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:48.108661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8932354-e9eb-47bc-84a3-0449cfdf3e5c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.189190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.223552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828c61-4383-406c-8233-f68bedc69ce9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.230050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8932354-e9eb-47bc-84a3-0449cfdf3e5c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.270759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.271396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.271691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.271957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.272764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:48.273077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.274574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.280047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.280800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.281081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.281385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.286490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 180/364] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=bd4182637160412da90e2d257ec550ce => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:48.286998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:48.287108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.287181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.287181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.295815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 185/365] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:48.296883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.353230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.423956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5a7ca-5a64-426b-b2d0-ff76bd02163e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.432265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b788e59-9068-4977-903c-e693b6c823b1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.458557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.464688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.465357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.465630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.465904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.467000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:48.467302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.470103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.475251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.475251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.475251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.475508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.477550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.478267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.479421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 181/366] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:48.480048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.481141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 186/367] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:48.482028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.597229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994585ab-cf11-4e47-92af-76d793174937 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.601301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a521c-ffbb-4e12-be66-9620ec65c40a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.611511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.633123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.633814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.634094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.634368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.641693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.642435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.642731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.643253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] PATH_INFO: `/v3/users/b574479da4914ce49740db6327508ec4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.644891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] RBAC: Authorizing `identity:get_user(user_id=b574479da4914ce49740db6327508ec4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.646713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.646899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:48.648716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 187/368] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/users/b574479da4914ce49740db6327508ec4 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:48.649527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:48.652368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:48.654490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:48.656658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:48.660001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 182/369] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:48.660001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.734402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.766281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1099-7f10-4ebb-9520-f6a2222dcd1f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.783910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a9b3-66b2-417f-af5e-f0dd98d656bc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.804957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.805687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.805971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.806246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.819227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.819857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.820140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.820418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.821222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=7ac77299c12c4076922faff7ff3815e5) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:48.821561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.823037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.828824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 183/370] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=bd4182637160412da90e2d257ec550ce => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:48.830608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:48.875139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.916783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.918400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:48.943334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2bd2-98a9-455c-81e0-ee3a70291702 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:48.962625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:48.980577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:48.981222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:48.985896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:48.986148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:48.986870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:48.987251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:48.988703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:49.003851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 184/371] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:49.004495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.051220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 188/372] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:49.052106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.143605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:49.169202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d03fe-ef63-49d0-a2fd-aeaacc8ef61c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:49.171684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22907cee-40a1-4b0e-8a37-a73768ab834c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:49.209902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:49.210542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.210818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.211090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.243045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:49.243628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.243908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.244225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.245049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] RBAC: Adding query filter params (role.id=f033f6b999024d23a84b1b858c130c0a, user.id=b574479da4914ce49740db6327508ec4, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:49.245378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:49.258125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:49.288729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 185/373] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/role_assignments?user.id=b574479da4914ce49740db6327508ec4&scope.system=all&role.id=f033f6b999024d23a84b1b858c130c0a => generated 510 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:49.289589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.341468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:49.341468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:49.351747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:49.413521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9a15-d229-4f3d-83d9-160f1a6cc1b0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:49.458971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:49.474669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:49.475346 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.475624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.475901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.480528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:49.484836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:49.486741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 186/374] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:49.493431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.494505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 189/375] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:49.500431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.627521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784503bf-cdc8-470c-98d5-f9d6efa70597 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:49.666894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc656-a9ae-4c68-bd5b-3bf2e8a31e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:49.667545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc656-a9ae-4c68-bd5b-3bf2e8a31e55 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.667824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc656-a9ae-4c68-bd5b-3bf2e8a31e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.668099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc656-a9ae-4c68-bd5b-3bf2e8a31e55 None admin] PATH_INFO: `/v3/projects/946d886e0ff64f17b40801862b894e7d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.669266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc656-a9ae-4c68-bd5b-3bf2e8a31e55 None admin] RBAC: Authorizing `identity:get_project(project_id=946d886e0ff64f17b40801862b894e7d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:49.671011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc656-a9ae-4c68-bd5b-3bf2e8a31e55 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:49.672996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 190/376] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/projects/946d886e0ff64f17b40801862b894e7d => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:49.673585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b07a0-d05b-4ff6-8236-633a8dcb22d5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:49.674265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676df933-2430-4ae9-a18c-025c825b5ede None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.674467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676df933-2430-4ae9-a18c-025c825b5ede None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.674811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676df933-2430-4ae9-a18c-025c825b5ede None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.676343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 191/377] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:49.679655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676df933-2430-4ae9-a18c-025c825b5ede None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.681317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:49.712389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55377c-1623-4bea-bc1e-613af1ac4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:49.713042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55377c-1623-4bea-bc1e-613af1ac4bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.713351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55377c-1623-4bea-bc1e-613af1ac4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.713628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55377c-1623-4bea-bc1e-613af1ac4bb9 None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.714797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55377c-1623-4bea-bc1e-613af1ac4bb9 None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:49.716862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55377c-1623-4bea-bc1e-613af1ac4bb9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:49.719028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 187/378] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:49.720510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8e850-16f1-444c-8cfd-be5cfec56716 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.721120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8e850-16f1-444c-8cfd-be5cfec56716 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.721611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8e850-16f1-444c-8cfd-be5cfec56716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.734106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:49.746081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bbc8e850-16f1-444c-8cfd-be5cfec56716 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:49.747226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bbc8e850-16f1-444c-8cfd-be5cfec56716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:49.803220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676df933-2430-4ae9-a18c-025c825b5ede None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:49.828788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 188/379] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:49.829569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8e850-16f1-444c-8cfd-be5cfec56716 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.847629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:49.848293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:49.848578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:49.848858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] PATH_INFO: `/v3/groups/2bdc7d09d539404499892f49b5dd71b5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:49.856628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] RBAC: Authorizing `identity:get_group(group_id=2bdc7d09d539404499892f49b5dd71b5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:49.858062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:49.860662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 192/380] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/groups/2bdc7d09d539404499892f49b5dd71b5 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:49.866674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:49.968110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8e850-16f1-444c-8cfd-be5cfec56716 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:49.997843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:50.003024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78f13-5ec1-4d17-beea-126362b30a04 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:50.007290 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:50.007995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:50.008342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:50.008685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:50.009593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=7ac77299c12c4076922faff7ff3815e5) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:50.010012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:50.011529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:50.013039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:50.018796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 189/381] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=d8ac88c62f844b499ed53400465ff365 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:50.020577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:50.047435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:50.048090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:50.048674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:50.048843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:50.050008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] RBAC: Adding query filter params (group.id=2bdc7d09d539404499892f49b5dd71b5, role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=946d886e0ff64f17b40801862b894e7d) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:50.050459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:50.052263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:50.060378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 193/382] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:49 2022] GET /identity/v3/role_assignments?group.id=2bdc7d09d539404499892f49b5dd71b5&scope.project.id=946d886e0ff64f17b40801862b894e7d&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:50.135701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424b24-483b-4fff-8149-aa22dcecc651 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:50.173841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:50.174510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:50.174788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:50.175061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:50.188777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:50.194723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:50.195770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:50.197048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 190/383] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:50.202699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:50.341702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b0b0-2e62-4f48-9ba4-53eb0944a162 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:50.377168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:50.377828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:50.378110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:50.378385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:50.379110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:50.379424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:50.380802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:50.389708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 194/384] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:50.395584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:50.425134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:50.500017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0980552-61bb-45dc-8375-2d8e3ffbb09d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:50.536050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:50.536757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:50.537042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:50.537344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:50.538653 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:50.540883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:50.542875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 191/385] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:50 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:50.548532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:50.586576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:50.668939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcb58f-c346-4dc3-967f-08abf07f8f20 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:50.713225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a9d0-8a6a-407f-9c75-b4c5f8adfb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:50.713903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a9d0-8a6a-407f-9c75-b4c5f8adfb76 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:50.714178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a9d0-8a6a-407f-9c75-b4c5f8adfb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:50.714467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a9d0-8a6a-407f-9c75-b4c5f8adfb76 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:50.718052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a9d0-8a6a-407f-9c75-b4c5f8adfb76 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:50.719518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a9d0-8a6a-407f-9c75-b4c5f8adfb76 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:50.721661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 195/386] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:50 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:50.727048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:50.846390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:50.853085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6dc0-d8e1-4d54-be17-cc776c5b29ca None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:50.889907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2947-24b8-4991-aca0-b09698157f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:50.891043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2947-24b8-4991-aca0-b09698157f77 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:50.891538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2947-24b8-4991-aca0-b09698157f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:50.891961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2947-24b8-4991-aca0-b09698157f77 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:50.894286 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2947-24b8-4991-aca0-b09698157f77 None admin] RBAC: Authorizing `identity:create_grant(project_id=656dd4f282c64dd290d9506d8a1c14e8, group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:50.895759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2947-24b8-4991-aca0-b09698157f77 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:50.916357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 192/387] 10.222.0.47 () {58 vars in 1442 bytes} [Fri Jul 29 08:18:50 2022] PUT /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/d8ac88c62f844b499ed53400465ff365 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:51.216428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab609b9-1055-4081-a7d9-c3b15906c603 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:51.216793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab609b9-1055-4081-a7d9-c3b15906c603 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:51.216984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab609b9-1055-4081-a7d9-c3b15906c603 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:51.218765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 196/388] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:51.224392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d5039-c1c0-48a2-a40e-925c6a0ab915 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:51.224938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d5039-c1c0-48a2-a40e-925c6a0ab915 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:51.225442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d5039-c1c0-48a2-a40e-925c6a0ab915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:51.257623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-809d5039-c1c0-48a2-a40e-925c6a0ab915 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:51.259052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-809d5039-c1c0-48a2-a40e-925c6a0ab915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:51.340558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 193/389] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:51.379558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab609b9-1055-4081-a7d9-c3b15906c603 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:51.518594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab609b9-1055-4081-a7d9-c3b15906c603 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:51.520245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:51.563183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79afd91-2d10-4ea0-ab14-50bdf715b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:51.563865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79afd91-2d10-4ea0-ab14-50bdf715b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:51.564122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79afd91-2d10-4ea0-ab14-50bdf715b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:51.564380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79afd91-2d10-4ea0-ab14-50bdf715b4c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:51.584353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79afd91-2d10-4ea0-ab14-50bdf715b4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c79afd91-2d10-4ea0-ab14-50bdf715b4c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:51.589422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:51.590291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:51.591478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 197/390] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:51.597083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d5039-c1c0-48a2-a40e-925c6a0ab915 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:51.636603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4d32-5468-4b74-9337-a87f6d27f99c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:51.636928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4d32-5468-4b74-9337-a87f6d27f99c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:51.637178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4d32-5468-4b74-9337-a87f6d27f99c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:51.638595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 198/391] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:51.646603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05dd2-1ca7-4d7d-82a6-1b2f6ce602fc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:51.647478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05dd2-1ca7-4d7d-82a6-1b2f6ce602fc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:51.647772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05dd2-1ca7-4d7d-82a6-1b2f6ce602fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:51.679701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9cc05dd2-1ca7-4d7d-82a6-1b2f6ce602fc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:51.682877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9cc05dd2-1ca7-4d7d-82a6-1b2f6ce602fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:51.716942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:51.739925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d5039-c1c0-48a2-a40e-925c6a0ab915 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:51.786003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:51.786554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:51.786838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:51.787114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:51.787845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:51.788151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:51.789574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:51.808085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 199/392] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:51.813390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 194/393] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:51.815051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05dd2-1ca7-4d7d-82a6-1b2f6ce602fc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:51.843053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:51.981569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:51.994553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05dd2-1ca7-4d7d-82a6-1b2f6ce602fc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.022582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3af1-368e-4541-96c5-fbb2e6caef59 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.065520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.066104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.066385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.066662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.068423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:52.069910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:52.071542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 200/394] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:51 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:52.079064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:52.096041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.096709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.096995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.097293 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.115469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:52.121396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:52.122272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:52.123115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:52.125587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 195/395] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:18:52.131269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:52.146985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:52.207815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071950-e4e5-4d53-9dcd-f228c077c632 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.249939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.249939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.249939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.249939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.250352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:52.251154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:52.257585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 201/396] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:52 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:52.259525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:52.292831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:52.338915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155003-e3ff-470b-a972-d985b2263e98 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.378251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a5f3-b4b7-475d-a30c-3c03104a934a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.410843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.411651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.412085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.412458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.413297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:52.413722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:52.415307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:52.424544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12070bfa-e034-427a-b425-557196712b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.425513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12070bfa-e034-427a-b425-557196712b3c None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.425952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12070bfa-e034-427a-b425-557196712b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.426373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12070bfa-e034-427a-b425-557196712b3c None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.429912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 196/397] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:52.430854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12070bfa-e034-427a-b425-557196712b3c None admin] RBAC: Authorizing `identity:create_grant(project_id=656dd4f282c64dd290d9506d8a1c14e8, group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:52.432512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12070bfa-e034-427a-b425-557196712b3c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:52.435779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:52.485308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 202/398] 10.222.0.47 () {58 vars in 1442 bytes} [Fri Jul 29 08:18:52 2022] PUT /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:52.536193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:52.571401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f2db9-bd3a-4ada-9e16-7910f1c193cc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.612159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ee6a-93c4-4903-a329-320907254a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.612805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ee6a-93c4-4903-a329-320907254a1d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.613028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ee6a-93c4-4903-a329-320907254a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.613314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ee6a-93c4-4903-a329-320907254a1d None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.614591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ee6a-93c4-4903-a329-320907254a1d None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:52.616119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ee6a-93c4-4903-a329-320907254a1d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:52.618307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 197/399] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:52 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:52.623585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12070bfa-e034-427a-b425-557196712b3c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:52.708491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b85973-01f1-4cf5-8ae1-5a63fe8a4e51 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.708846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b85973-01f1-4cf5-8ae1-5a63fe8a4e51 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.709053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b85973-01f1-4cf5-8ae1-5a63fe8a4e51 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.710888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 198/400] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:52.716355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49e14-130c-4b00-b4b0-67bdefb6342a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.716913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49e14-130c-4b00-b4b0-67bdefb6342a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.717517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49e14-130c-4b00-b4b0-67bdefb6342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.742720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-19b49e14-130c-4b00-b4b0-67bdefb6342a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:52.744364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-19b49e14-130c-4b00-b4b0-67bdefb6342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:52.778418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:52.793749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12070bfa-e034-427a-b425-557196712b3c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.836310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.836976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.837263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.837576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.838957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:52.840444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:52.841601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 199/401] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:52.842974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 203/402] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:52 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:52.843349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d4aa-1f11-4ffd-841f-784b02e99b83 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.843640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d4aa-1f11-4ffd-841f-784b02e99b83 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.843942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d4aa-1f11-4ffd-841f-784b02e99b83 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.845367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 200/403] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:52.853235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:52.855153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d11368-559f-47b4-9fa2-3e85906a1e56 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.855704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d11368-559f-47b4-9fa2-3e85906a1e56 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.856222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d11368-559f-47b4-9fa2-3e85906a1e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.876585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-14d11368-559f-47b4-9fa2-3e85906a1e56 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:52.878227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-14d11368-559f-47b4-9fa2-3e85906a1e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:52.943631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:52.955652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 201/404] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:52.955652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d11368-559f-47b4-9fa2-3e85906a1e56 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:52.958860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312b8e6-5403-4fdf-9e8a-2592f13e783e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:52.995842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:52.996359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:52.996682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:52.996959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:52.999195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ac77299c12c4076922faff7ff3815e5, group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:53.000725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:53.019460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 204/405] 10.222.0.47 () {58 vars in 1442 bytes} [Fri Jul 29 08:18:52 2022] PUT /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:18:53.020371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.053394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:53.086399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d11368-559f-47b4-9fa2-3e85906a1e56 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.138078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.139217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.140839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.141379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.162730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:53.174296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:53.175294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:53.176091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:53.180163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 202/406] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:53.190704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.224333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dda3b-c691-4fce-98ee-2ae645acb2c2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.266906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.267941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.268420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.268903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.284308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:53.292698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:53.293668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:53.294474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:53.300159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 205/407] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:53.302316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.312600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:53.356993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61391e8-539a-4335-a6a3-01a366f8db57 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.391337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:53.394374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.395393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.395777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.396169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.397058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:53.398810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:53.400085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:53.409838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 203/408] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:53.418563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.432128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef5db-a62c-42e7-bb02-391e897f5a51 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.483984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.484628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.484912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.485195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.485972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:53.486615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:53.488158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:53.497849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 206/409] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:53.504933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.613909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d43b6-6139-4cf1-a7c3-88e2c5289d8e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.636457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:53.648472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613211-902b-4eaf-8a0c-324c5841459f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.652000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89584844-9d34-4e2e-bd34-fb61626744ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.652895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89584844-9d34-4e2e-bd34-fb61626744ec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.653416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89584844-9d34-4e2e-bd34-fb61626744ec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.653883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89584844-9d34-4e2e-bd34-fb61626744ec None admin] PATH_INFO: `/v3/groups/2bdc7d09d539404499892f49b5dd71b5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.655395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89584844-9d34-4e2e-bd34-fb61626744ec None admin] RBAC: Authorizing `identity:get_group(group_id=2bdc7d09d539404499892f49b5dd71b5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:53.657054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89584844-9d34-4e2e-bd34-fb61626744ec None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:53.659377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 204/410] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/groups/2bdc7d09d539404499892f49b5dd71b5 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:53.660934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1058b8-4400-43ac-8b71-5bf044b64e63 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.661455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1058b8-4400-43ac-8b71-5bf044b64e63 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.661921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1058b8-4400-43ac-8b71-5bf044b64e63 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.663637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 205/411] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:53.664578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1058b8-4400-43ac-8b71-5bf044b64e63 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.688299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451b271-2419-40b8-aa89-4811e092228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.688951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b271-2419-40b8-aa89-4811e092228e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.689333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b271-2419-40b8-aa89-4811e092228e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.689534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b271-2419-40b8-aa89-4811e092228e None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.690716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b271-2419-40b8-aa89-4811e092228e None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:53.692308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b271-2419-40b8-aa89-4811e092228e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:53.694113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 207/412] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:53.695566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f30fe-0b57-4558-bfb8-2d1e7a0842fa None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.695833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f30fe-0b57-4558-bfb8-2d1e7a0842fa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.696361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f30fe-0b57-4558-bfb8-2d1e7a0842fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.708955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:53.715373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7b6f30fe-0b57-4558-bfb8-2d1e7a0842fa None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:53.717901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7b6f30fe-0b57-4558-bfb8-2d1e7a0842fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:53.775893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1058b8-4400-43ac-8b71-5bf044b64e63 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.786572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 208/413] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:53.793911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f30fe-0b57-4558-bfb8-2d1e7a0842fa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.815015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.816047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.816571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.817109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] PATH_INFO: `/v3/projects/946d886e0ff64f17b40801862b894e7d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.818591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] RBAC: Authorizing `identity:get_project(project_id=946d886e0ff64f17b40801862b894e7d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:53.820383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:53.822464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 206/414] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/projects/946d886e0ff64f17b40801862b894e7d => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:53.829365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.895882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:53.915880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f30fe-0b57-4558-bfb8-2d1e7a0842fa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.955510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:53.956161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:53.956444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:53.956645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494951-b42d-4222-ba1c-e8fbe66bb621 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:53.956776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:53.957984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:53.960095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:53.961311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 209/415] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:53.962087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:53.966916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:54.004721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:54.005708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:54.006123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:54.006547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] PATH_INFO: `/v3/projects/946d886e0ff64f17b40801862b894e7d/groups/2bdc7d09d539404499892f49b5dd71b5/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:54.009608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] RBAC: Authorizing `identity:create_grant(project_id=946d886e0ff64f17b40801862b894e7d, group_id=2bdc7d09d539404499892f49b5dd71b5, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:54.011795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:54.032065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 207/416] 10.222.0.47 () {58 vars in 1442 bytes} [Fri Jul 29 08:18:53 2022] PUT /identity/v3/projects/946d886e0ff64f17b40801862b894e7d/groups/2bdc7d09d539404499892f49b5dd71b5/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:54.033149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:54.136354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b99da-f45e-4fa0-b556-eb2aa17f9fb1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:54.159844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f7c87-8beb-4f73-9f9a-ea17ec37e93c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:54.180235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:54.205154 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:54.206699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:54.207171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:54.207708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:54.210290 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ac77299c12c4076922faff7ff3815e5, group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:54.212269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:54.227238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:54.228070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:54.228425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:54.228770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:54.231487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 208/417] 10.222.0.47 () {58 vars in 1442 bytes} [Fri Jul 29 08:18:54 2022] PUT /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb/roles/d8ac88c62f844b499ed53400465ff365 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:18:54.257626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:54.263978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:54.265051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:54.265887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:54.268360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 210/418] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:54.274747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:54.393196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9c11-a6c5-4d5e-baaf-8b9499b3dfa9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:54.440545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbc7cb-7532-44b8-86f1-662aa48636ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:54.441105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbc7cb-7532-44b8-86f1-662aa48636ce None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:54.441428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbc7cb-7532-44b8-86f1-662aa48636ce None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:54.441715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbc7cb-7532-44b8-86f1-662aa48636ce None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:54.442448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbc7cb-7532-44b8-86f1-662aa48636ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:54.442755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbc7cb-7532-44b8-86f1-662aa48636ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:54.444150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbc7cb-7532-44b8-86f1-662aa48636ce None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:54.464179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 209/419] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:54.470422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:54.539777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:54.583482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e7b4f-45ee-479f-99ea-60a955c7245b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:54.624778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798657-3257-4027-ac82-30629da38e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:54.625723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798657-3257-4027-ac82-30629da38e07 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:54.626148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798657-3257-4027-ac82-30629da38e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:54.626559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798657-3257-4027-ac82-30629da38e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:54.730537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63798657-3257-4027-ac82-30629da38e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:54.732658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63798657-3257-4027-ac82-30629da38e07 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:54.751589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd52a3-0fe7-4e22-8276-e1dbb17484b3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:54.752108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd52a3-0fe7-4e22-8276-e1dbb17484b3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:54.752363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd52a3-0fe7-4e22-8276-e1dbb17484b3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:54.754110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 210/420] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:18:54.759008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebef9-7546-4e99-a069-f51297e219d2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:54.759410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebef9-7546-4e99-a069-f51297e219d2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:54.759788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebef9-7546-4e99-a069-f51297e219d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:54.778988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fcdebef9-7546-4e99-a069-f51297e219d2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:54.780401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fcdebef9-7546-4e99-a069-f51297e219d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:54.814216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:54.859164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:54.862706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 211/421] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:54.868570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798657-3257-4027-ac82-30629da38e07 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:54.954945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 211/422] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:54.981046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798657-3257-4027-ac82-30629da38e07 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:54.998053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdebef9-7546-4e99-a069-f51297e219d2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:55.021668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:55.022644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.023752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.024344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.027069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:55.028830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:55.031709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 212/423] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:54 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:55.037820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:55.076321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:55.200892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdebef9-7546-4e99-a069-f51297e219d2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:55.201310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b405af-eb87-4f56-83e5-8c090da39a35 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:55.274979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:55.276414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.277302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.278102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.279830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:55.280856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.282536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.283257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.287163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:55.288813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:55.290885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 213/424] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:55 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:55.298274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:55.309101 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:55.317039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:55.317946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:55.318827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:55.329673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 212/425] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:18:55.330934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:55.369195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:55.428106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:55.436625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955d59-1f6d-4655-892c-04a6a30f1a44 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:55.473423 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493dae-afda-4cdd-b478-1816a1c37ea4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:55.499090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd735f-3858-491b-9882-b0803fb2aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:55.499810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd735f-3858-491b-9882-b0803fb2aea1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.500120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd735f-3858-491b-9882-b0803fb2aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.500397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd735f-3858-491b-9882-b0803fb2aea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.501306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd735f-3858-491b-9882-b0803fb2aea1 None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:55.501725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd735f-3858-491b-9882-b0803fb2aea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:55.503241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd735f-3858-491b-9882-b0803fb2aea1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:55.509690 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 214/426] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:55 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=d8ac88c62f844b499ed53400465ff365 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:55.510867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253db38-7452-444a-b6bb-a3f95ec6c7fe None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.511151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253db38-7452-444a-b6bb-a3f95ec6c7fe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.511426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253db38-7452-444a-b6bb-a3f95ec6c7fe None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.512909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 215/427] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:55.513442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:55.514369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.514839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.515245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.516148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:55.516597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:55.518378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:55.518648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a6a5-ddf1-4711-ba02-ec06b073510c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.518937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a6a5-ddf1-4711-ba02-ec06b073510c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.519213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a6a5-ddf1-4711-ba02-ec06b073510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.529457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 213/428] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:55.534825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:55.538230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-90e0a6a5-ddf1-4711-ba02-ec06b073510c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:55.540004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-90e0a6a5-ddf1-4711-ba02-ec06b073510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:55.610406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 216/429] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:55.633415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0a6a5-ddf1-4711-ba02-ec06b073510c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:55.639552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:55.658528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0430b-fe70-4561-8153-4bad047c4294 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:55.700095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:55.700982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.701508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.702622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.786729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:55.789352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:55.813621 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:55.822688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0a6a5-ddf1-4711-ba02-ec06b073510c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:55.870811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:55.871458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:55.872901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:55.873313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:55.885942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:55.892946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:55.894115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 08:18:55.895139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:55.897536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 217/430] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:55.904729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:55.912188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:55.925456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 214/431] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 08:18:55.934340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.040122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748268b5-9323-4c18-a79b-1ee5477b2f5a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.065823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedce02-4bbd-4f87-8652-66fe3f870a9b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.082675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.083311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.083596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.084023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.085125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:56.085478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.087814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.099035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 218/432] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:56.104096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.113219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.114398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.114683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.114964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] PATH_INFO: `/v3/projects/656dd4f282c64dd290d9506d8a1c14e8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.116662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] RBAC: Authorizing `identity:get_project(project_id=656dd4f282c64dd290d9506d8a1c14e8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.118860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.121553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 215/433] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:55 2022] GET /identity/v3/projects/656dd4f282c64dd290d9506d8a1c14e8 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:56.127003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.127328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:56.191039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:56.219895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992eadb-7c12-4979-ad53-091ce6ec5b6d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.236021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c7ccc-aae6-4842-8b33-f9f95f49b77b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.273209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.273585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.274315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.274483 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.274730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.275033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.275150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.275627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.276374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.278004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.280984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 216/434] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:56.287086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.351242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.352881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.371077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:56.394511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7a2ad-e1af-4320-8746-228418658ea3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.420387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:56.430856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6846-0405-4021-87a0-33d593f5268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.431480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6846-0405-4021-87a0-33d593f5268a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.431756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6846-0405-4021-87a0-33d593f5268a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.432025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6846-0405-4021-87a0-33d593f5268a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.432829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c6846-0405-4021-87a0-33d593f5268a None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=656dd4f282c64dd290d9506d8a1c14e8) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:56.433135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c6846-0405-4021-87a0-33d593f5268a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.434628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c6846-0405-4021-87a0-33d593f5268a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.441225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 217/435] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=656dd4f282c64dd290d9506d8a1c14e8&role.id=bd4182637160412da90e2d257ec550ce => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:56.442285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706b60-15ea-4098-9043-b280f6f87fb8 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.442565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706b60-15ea-4098-9043-b280f6f87fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.442837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706b60-15ea-4098-9043-b280f6f87fb8 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.444206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 218/436] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:56.449666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cd18-76a0-4032-8e31-1f170c4f2731 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.449945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cd18-76a0-4032-8e31-1f170c4f2731 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.450218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cd18-76a0-4032-8e31-1f170c4f2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.469951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6944cd18-76a0-4032-8e31-1f170c4f2731 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:56.471199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6944cd18-76a0-4032-8e31-1f170c4f2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:56.479882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 219/437] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 08:18:56.485879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.561317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 219/438] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:18:56.592029 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cd18-76a0-4032-8e31-1f170c4f2731 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.614894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045c2d-5d12-4c89-a047-53a018b2ccb3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.634955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:56.659970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.660801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.661088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.661801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.662998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.664441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.666477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 220/439] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:56.678348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.710872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cd18-76a0-4032-8e31-1f170c4f2731 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.733947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:56.751842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a250c-0235-424b-8f9a-127f8f7165c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.753079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a250c-0235-424b-8f9a-127f8f7165c0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.753390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a250c-0235-424b-8f9a-127f8f7165c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.753670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a250c-0235-424b-8f9a-127f8f7165c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.767722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a250c-0235-424b-8f9a-127f8f7165c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-904a250c-0235-424b-8f9a-127f8f7165c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:56.772677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:56.773646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:18:56.775693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 220/440] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:18:56.776516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e412e5-6f3e-490b-9765-6354afb17e3f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.776516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e412e5-6f3e-490b-9765-6354afb17e3f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.776516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e412e5-6f3e-490b-9765-6354afb17e3f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.777926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 221/441] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:18:56.780571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e412e5-6f3e-490b-9765-6354afb17e3f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.801235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eaa75-4891-4990-a0b9-4a7e10210070 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.842431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a4b93-8584-45dc-9b35-308797890f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.844332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a4b93-8584-45dc-9b35-308797890f6b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.844332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a4b93-8584-45dc-9b35-308797890f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.844534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a4b93-8584-45dc-9b35-308797890f6b None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.845773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a4b93-8584-45dc-9b35-308797890f6b None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.847608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a4b93-8584-45dc-9b35-308797890f6b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.848983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 221/442] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:56.850168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a759fe-7c0f-46bc-8263-c24a2f390abb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.850289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a759fe-7c0f-46bc-8263-c24a2f390abb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.850545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a759fe-7c0f-46bc-8263-c24a2f390abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.871678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a3a759fe-7c0f-46bc-8263-c24a2f390abb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:18:56.872798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a3a759fe-7c0f-46bc-8263-c24a2f390abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:18:56.911131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e412e5-6f3e-490b-9765-6354afb17e3f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:56.923278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:56.951352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 222/443] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:18:56.951594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:56.952089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:56.952370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:56.952701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:56.952853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a759fe-7c0f-46bc-8263-c24a2f390abb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:56.954245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:56.954245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:56.955164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:56.964435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 222/444] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:56.972159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.021790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:57.068259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a759fe-7c0f-46bc-8263-c24a2f390abb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.077630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b67d4-411a-4121-a7f7-1548d07b1510 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.101057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.101704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.101986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.102261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.103056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=bd4182637160412da90e2d257ec550ce, scope.project.id=7ac77299c12c4076922faff7ff3815e5) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:57.103362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.104817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.110503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 223/445] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=bd4182637160412da90e2d257ec550ce => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:57.110631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.111264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.111360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.111596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.111823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.165217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:57.194428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.195938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.228951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a84720-5d5e-4827-bf39-f9d0446fcc89 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.245040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:57.277175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.277875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.278158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.278431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.290750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:18:57.296368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:18:57.297502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:18:57.298509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 224/446] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:18:57.304036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.318621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 223/447] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:57.324055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.419605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf4f85-f02f-4d02-92b2-8b09f763e884 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.427865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:57.433176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf403b-34b3-47b7-be8f-e05e02728ff3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.464743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.465411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.466165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.466448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.467336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:57.467657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.469005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.471602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.472254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.472536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.472814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] PATH_INFO: `/v3/projects/946d886e0ff64f17b40801862b894e7d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.474074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] RBAC: Authorizing `identity:get_project(project_id=946d886e0ff64f17b40801862b894e7d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.475529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.477204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 224/448] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/projects/946d886e0ff64f17b40801862b894e7d => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:57.478184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 225/449] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:57.482571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.483687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.494766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:57.580485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb3f5-1891-496f-aec2-7161669a3186 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.580936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45e98b-dcdd-4d74-a285-1cc05d6ec515 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.613885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.614044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.614508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.614624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.614791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.614906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.615068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.615163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] PATH_INFO: `/v3/groups/2bdc7d09d539404499892f49b5dd71b5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.616274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] RBAC: Authorizing `identity:get_group(group_id=2bdc7d09d539404499892f49b5dd71b5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.617780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.619380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 225/450] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/groups/2bdc7d09d539404499892f49b5dd71b5 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:57.625139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.648356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:57.680769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.682174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.702697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:57.725300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b6860-3a1f-4c38-8cf6-1f98a5901bea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.759255 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.759870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.760150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.760425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.761215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] RBAC: Adding query filter params (group.id=2bdc7d09d539404499892f49b5dd71b5, role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=946d886e0ff64f17b40801862b894e7d) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:57.761556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.763002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.769117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 226/451] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/role_assignments?group.id=2bdc7d09d539404499892f49b5dd71b5&scope.project.id=946d886e0ff64f17b40801862b894e7d&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:18:57.781325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 226/452] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:18:57.787268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:57.900565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1df7e5-8393-447d-a6e7-3e2f12155991 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:57.937451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:57.938066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:57.938304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:57.938578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] PATH_INFO: `/v3/projects/7ac77299c12c4076922faff7ff3815e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:57.939722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] RBAC: Authorizing `identity:get_project(project_id=7ac77299c12c4076922faff7ff3815e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:57.941960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:57.942881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 227/453] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/projects/7ac77299c12c4076922faff7ff3815e5 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:57.948636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:58.021254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:58.055785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a39f2-714a-441c-851e-c538c84e0d86 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:58.091214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222e4a7-2f0f-410c-8caf-e182d7e33d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:58.091863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e4a7-2f0f-410c-8caf-e182d7e33d66 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:58.092172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e4a7-2f0f-410c-8caf-e182d7e33d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:58.092452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e4a7-2f0f-410c-8caf-e182d7e33d66 None admin] PATH_INFO: `/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:58.093701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222e4a7-2f0f-410c-8caf-e182d7e33d66 None admin] RBAC: Authorizing `identity:get_group(group_id=6b7a2f8f28294a8cb1ebd4add6e1dffb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:58.095165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222e4a7-2f0f-410c-8caf-e182d7e33d66 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:58.096752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 227/454] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Jul 29 08:18:57 2022] GET /identity/v3/groups/6b7a2f8f28294a8cb1ebd4add6e1dffb => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:18:58.102992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:18:58.116207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:18:58.208326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543dee-0dfd-429b-9bb2-6d65bc65eaf6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:18:58.244317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f875b6-2254-4eae-a42f-a89c5c427fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:18:58.244934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f875b6-2254-4eae-a42f-a89c5c427fcc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:18:58.245217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f875b6-2254-4eae-a42f-a89c5c427fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:18:58.245514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f875b6-2254-4eae-a42f-a89c5c427fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:18:58.246313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f875b6-2254-4eae-a42f-a89c5c427fcc None admin] RBAC: Adding query filter params (group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb, role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=7ac77299c12c4076922faff7ff3815e5) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:18:58.246625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f875b6-2254-4eae-a42f-a89c5c427fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:18:58.248083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f875b6-2254-4eae-a42f-a89c5c427fcc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:18:58.254450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 228/455] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Jul 29 08:18:58 2022] GET /identity/v3/role_assignments?group.id=6b7a2f8f28294a8cb1ebd4add6e1dffb&scope.project.id=7ac77299c12c4076922faff7ff3815e5&role.id=d8ac88c62f844b499ed53400465ff365 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:00.812915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4d61-4642-477e-b0b4-291ac672814e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:00.813933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4d61-4642-477e-b0b4-291ac672814e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:00.814456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4d61-4642-477e-b0b4-291ac672814e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:00.816253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 228/456] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:00.822088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b14331-8315-43cd-ba69-70a08e97c8b9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:00.822945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b14331-8315-43cd-ba69-70a08e97c8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:00.823416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b14331-8315-43cd-ba69-70a08e97c8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:00.854301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-88b14331-8315-43cd-ba69-70a08e97c8b9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:00.855842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-88b14331-8315-43cd-ba69-70a08e97c8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:00.942538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 229/457] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:19:00.980508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8aa3-9459-4ead-86a4-1cf8b93fa267 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:00.981473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8aa3-9459-4ead-86a4-1cf8b93fa267 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:00.981950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8aa3-9459-4ead-86a4-1cf8b93fa267 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:00.982198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b14331-8315-43cd-ba69-70a08e97c8b9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:00.984049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 229/458] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:00.985724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:00.990932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9789da-a266-47fc-a430-b56b76508924 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:00.991654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9789da-a266-47fc-a430-b56b76508924 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:00.992131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9789da-a266-47fc-a430-b56b76508924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.030247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cc9789da-a266-47fc-a430-b56b76508924 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:01.037907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cc9789da-a266-47fc-a430-b56b76508924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:01.101809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b14331-8315-43cd-ba69-70a08e97c8b9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.150622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:01.151669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.152145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.152632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.159881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 230/459] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:19:01.164113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:01.165838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:01.191051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:01.191983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:01.192814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:01.192814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:01.192814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:01.192814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:01.199508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 230/460] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:01.200617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9789da-a266-47fc-a430-b56b76508924 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:01.210854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:01.273754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:01.325249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e27b-0470-4dc6-88df-482a03abb869 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.369594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:01.383317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e08f3-74d8-4b53-bfa6-aaef0a8204c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:01.383965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e08f3-74d8-4b53-bfa6-aaef0a8204c8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.384243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e08f3-74d8-4b53-bfa6-aaef0a8204c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.384517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e08f3-74d8-4b53-bfa6-aaef0a8204c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.395652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e08f3-74d8-4b53-bfa6-aaef0a8204c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:01.397119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e08f3-74d8-4b53-bfa6-aaef0a8204c8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:01.406671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9789da-a266-47fc-a430-b56b76508924 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d45e08f3-74d8-4b53-bfa6-aaef0a8204c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:01.411993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:01.412823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 231/461] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cfba4-9256-4fde-b46d-4ff895ae4d28 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cfba4-9256-4fde-b46d-4ff895ae4d28 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cfba4-9256-4fde-b46d-4ff895ae4d28 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.418230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 232/462] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:01.418700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf7a6-d526-45b3-9401-8539c87e7b01 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.418700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf7a6-d526-45b3-9401-8539c87e7b01 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.418700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf7a6-d526-45b3-9401-8539c87e7b01 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.420202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 233/463] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:01.421620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5c648-c0db-4d27-b8fc-7a77d50ac15d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.421901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5c648-c0db-4d27-b8fc-7a77d50ac15d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.422175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5c648-c0db-4d27-b8fc-7a77d50ac15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.440706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-45c5c648-c0db-4d27-b8fc-7a77d50ac15d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:01.441921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-45c5c648-c0db-4d27-b8fc-7a77d50ac15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:01.452706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:01.453389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.453670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.453949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.454646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:01.454952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:01.456322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:01.478503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 231/464] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:01.478503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:01.519855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 234/465] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:01.530758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2f02-3f03-431f-b416-ea472ab480b2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.531252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2f02-3f03-431f-b416-ea472ab480b2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.532248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2f02-3f03-431f-b416-ea472ab480b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.554062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-92cd2f02-3f03-431f-b416-ea472ab480b2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:01.555263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-92cd2f02-3f03-431f-b416-ea472ab480b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:01.579643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6379-88da-4fa3-8293-3ea9ce15533b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.586159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:01.607010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:01.615468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:01.616097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.616377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.616655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.617369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:01.617675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:01.619052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:01.628006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 235/466] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:01.628534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd2f02-3f03-431f-b416-ea472ab480b2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:01.641003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 232/467] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:01.642341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:01.739909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd2f02-3f03-431f-b416-ea472ab480b2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.750265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1305-8b50-4fd9-9fda-449c6fedb34c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.774915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:01.775533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.775804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.776097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.776820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:01.778252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:01.786380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:01.787032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.787314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.787591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.799502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:01.800977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:01.809466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 236/468] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:19:01 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:01.810618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:01.824438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:01.825754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:01.826711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:01.826711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:01.826711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:01.826711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:01.829269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 233/469] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:01.830469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:01.840179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:01.890150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:01.929186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85ac2f-64e5-477c-b509-ec5103d486e7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.974754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:01.975011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c065-875d-48c6-bc4b-c41cd01462c4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:01.975841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:01.976275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:01.976687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:01.977562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:01.979059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:02.013258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 237/470] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:19:01 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:02.016215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:02.027288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:02.027959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.028243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.028583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.042980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:02.044509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:02.063317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:02.064232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:02.065077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:02.065077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:02.065077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:02.065077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:02.065077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 234/471] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:02.071377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:02.132724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:02.160801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0632-4ea1-4e0e-9c40-e188271086f0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:02.214949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:02.216397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:02.216848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.217299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.217581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.218795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:02.219218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:02.221737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:02.228353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fe959-951d-467b-94bb-1714670d2918 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:02.238279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 238/472] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:02.244982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:02.278163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4aac-1c58-4328-be4e-59c8cda6f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:02.278817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4aac-1c58-4328-be4e-59c8cda6f33d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.279101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4aac-1c58-4328-be4e-59c8cda6f33d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.279444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4aac-1c58-4328-be4e-59c8cda6f33d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.280355 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4aac-1c58-4328-be4e-59c8cda6f33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:02.280672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4aac-1c58-4328-be4e-59c8cda6f33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:02.283100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4aac-1c58-4328-be4e-59c8cda6f33d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:02.296355 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 235/473] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:02.298548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae8c7-7618-4a60-bd76-8a5affef96c6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.298838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae8c7-7618-4a60-bd76-8a5affef96c6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.299114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae8c7-7618-4a60-bd76-8a5affef96c6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.300598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 236/474] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:02.301310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae8c7-7618-4a60-bd76-8a5affef96c6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:02.366873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe37b6-2091-4f65-9985-f348055ae474 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:02.405160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae992185-d24e-4fd3-b1a6-4f75537189ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:02.405817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae992185-d24e-4fd3-b1a6-4f75537189ae None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.406096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae992185-d24e-4fd3-b1a6-4f75537189ae None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.406376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae992185-d24e-4fd3-b1a6-4f75537189ae None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.407041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae992185-d24e-4fd3-b1a6-4f75537189ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:02.408516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae992185-d24e-4fd3-b1a6-4f75537189ae None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:02.420935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:02.422982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae8c7-7618-4a60-bd76-8a5affef96c6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:02.435375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 239/475] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:19:02 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:02.437484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd0b3-2d2a-40a4-9373-70bb44c4dd44 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.437947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd0b3-2d2a-40a4-9373-70bb44c4dd44 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.438387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd0b3-2d2a-40a4-9373-70bb44c4dd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.459919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a45cd0b3-2d2a-40a4-9373-70bb44c4dd44 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:02.461431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a45cd0b3-2d2a-40a4-9373-70bb44c4dd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:02.491479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:02.491807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.492099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.492382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.493178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:02.494913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:02.546106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 237/476] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:19:02 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:02.579027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 240/477] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:02.602739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:02.615358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:02.733100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15801d-1c9a-4635-aea6-1f5722994256 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:02.770816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:02.771452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.771737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.772016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.772752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:02.774191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:02.784881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.sql.core [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 08:19:02.784881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 29 08:19:02.784881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [parameters: {'id': '6ba3be2c287e4123a90a37db5bb7340e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 29 08:19:02.784881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80210) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application conn.query(q) Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result.read() Jul 29 08:19:02.801116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return ref.to_dict() Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 08:19:02.802052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application next(self.gen) Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application yield resource Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application next(self.gen) Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise self.value Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application session.commit() Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 08:19:02.802962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.session.flush() Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application compat.raise_( Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 08:19:02.803846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 08:19:02.804756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application conn.query(q) Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result.read() Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 08:19:02.807169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [parameters: {'id': '6ba3be2c287e4123a90a37db5bb7340e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:02.809140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 29 08:19:02.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:02.814985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 238/478] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Jul 29 08:19:02 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:02.815121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd0b3-2d2a-40a4-9373-70bb44c4dd44 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:02.921792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd0b3-2d2a-40a4-9373-70bb44c4dd44 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:02.947778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:02.957082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa7b4c-b39d-43a5-bd17-49ab890fe3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:02.957773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa7b4c-b39d-43a5-bd17-49ab890fe3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:02.958054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa7b4c-b39d-43a5-bd17-49ab890fe3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:02.958333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa7b4c-b39d-43a5-bd17-49ab890fe3f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:02.969142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa7b4c-b39d-43a5-bd17-49ab890fe3f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-13fa7b4c-b39d-43a5-bd17-49ab890fe3f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:02.974114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:02.974961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:02.975763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 241/479] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:02.981336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:03.074948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:03.114000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46382e37-6fb2-4954-ab80-6995f3608b26 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:03.157949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c009f61-238d-48cf-abdf-9c38557cf579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:03.158578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009f61-238d-48cf-abdf-9c38557cf579 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:03.158862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009f61-238d-48cf-abdf-9c38557cf579 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:03.159137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009f61-238d-48cf-abdf-9c38557cf579 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:03.159862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c009f61-238d-48cf-abdf-9c38557cf579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:03.160168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c009f61-238d-48cf-abdf-9c38557cf579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:03.161583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c009f61-238d-48cf-abdf-9c38557cf579 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:03.172835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 239/480] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:04.262878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a683e4-2acc-4d17-8ffd-f76601496304 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:04.263399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a683e4-2acc-4d17-8ffd-f76601496304 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:04.263399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a683e4-2acc-4d17-8ffd-f76601496304 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:04.265539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 242/481] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:04.271359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ec04-b2ea-41de-ae0d-8e6678b53af1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:04.271796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ec04-b2ea-41de-ae0d-8e6678b53af1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:04.271975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ec04-b2ea-41de-ae0d-8e6678b53af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:04.301447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0d93ec04-b2ea-41de-ae0d-8e6678b53af1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:04.302659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0d93ec04-b2ea-41de-ae0d-8e6678b53af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:04.403501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 240/482] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:19:04.435031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a683e4-2acc-4d17-8ffd-f76601496304 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:04.531687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a460af-4aa1-4fbd-a97b-86318586cf0b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:04.531984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a460af-4aa1-4fbd-a97b-86318586cf0b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:04.532146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a460af-4aa1-4fbd-a97b-86318586cf0b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:04.533678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 241/483] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:19:04.539583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f16b-5a32-44f8-946a-0d363f55ae40 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:04.539902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f16b-5a32-44f8-946a-0d363f55ae40 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:04.540133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f16b-5a32-44f8-946a-0d363f55ae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:04.573756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c8a9f16b-5a32-44f8-946a-0d363f55ae40 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:04.574969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c8a9f16b-5a32-44f8-946a-0d363f55ae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:04.585139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a683e4-2acc-4d17-8ffd-f76601496304 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:04.649087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:04.649777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:04.650056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:04.650333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:04.669562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:04.674632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:04.675482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:04.676264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 243/484] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:04.683430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:04.691211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:04.708309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 242/485] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:04.743307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f16b-5a32-44f8-946a-0d363f55ae40 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:04.755895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:04.855317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5683d-7ff2-49fa-b347-b1afac3bcba1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:04.908136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:04.909750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f16b-5a32-44f8-946a-0d363f55ae40 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:04.911452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:04.911732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:04.912003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:04.912733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:04.913033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:04.915242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:04.932338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 244/486] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:04.940974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:04.983590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:04.984244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:04.984525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:04.984800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.004556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:05.011024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:05.011907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:05.012707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 243/487] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:05.019662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.115982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.119828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306efa6-7599-4060-be07-7d65860ee5b7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.131665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.157161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214f0a2-3b09-4a6a-8049-b2e47cc341a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.157842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f0a2-3b09-4a6a-8049-b2e47cc341a2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.158118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f0a2-3b09-4a6a-8049-b2e47cc341a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.158391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f0a2-3b09-4a6a-8049-b2e47cc341a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.171858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214f0a2-3b09-4a6a-8049-b2e47cc341a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:05.173323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214f0a2-3b09-4a6a-8049-b2e47cc341a2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:05.173572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63d2d-8927-4945-95ac-acaa5aaa9e74 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2214f0a2-3b09-4a6a-8049-b2e47cc341a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:05.190886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:05.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:05.192671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:05.192671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:05.192671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:05.192671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:05.192671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 245/488] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:05.198244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d821b3-38a8-4beb-b551-0a7ca3ddab81 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.198661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d821b3-38a8-4beb-b551-0a7ca3ddab81 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.199226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d821b3-38a8-4beb-b551-0a7ca3ddab81 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.200733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 246/489] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:05.201503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d821b3-38a8-4beb-b551-0a7ca3ddab81 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.218692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2a6e8-e257-4a73-8d81-0577d694f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.219647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a6e8-e257-4a73-8d81-0577d694f66d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.220215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a6e8-e257-4a73-8d81-0577d694f66d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.220678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a6e8-e257-4a73-8d81-0577d694f66d None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.221847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2a6e8-e257-4a73-8d81-0577d694f66d None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:05.222391 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2a6e8-e257-4a73-8d81-0577d694f66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:05.224022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2a6e8-e257-4a73-8d81-0577d694f66d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:05.233736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 244/490] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:05.240037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8db21-6dd2-4c78-884e-a0707ccf6c15 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.240574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8db21-6dd2-4c78-884e-a0707ccf6c15 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.241103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8db21-6dd2-4c78-884e-a0707ccf6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.267992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7da8db21-6dd2-4c78-884e-a0707ccf6c15 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:05.269980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7da8db21-6dd2-4c78-884e-a0707ccf6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:05.318658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d821b3-38a8-4beb-b551-0a7ca3ddab81 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.349324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 245/491] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:05.349324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8db21-6dd2-4c78-884e-a0707ccf6c15 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.362890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d95564-c82a-40ae-81ec-cbe3f68d629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.363755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d95564-c82a-40ae-81ec-cbe3f68d629f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.364205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d95564-c82a-40ae-81ec-cbe3f68d629f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.364621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d95564-c82a-40ae-81ec-cbe3f68d629f None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.365484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d95564-c82a-40ae-81ec-cbe3f68d629f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:05.367732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d95564-c82a-40ae-81ec-cbe3f68d629f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:05.369238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d95564-c82a-40ae-81ec-cbe3f68d629f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:05.381931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 247/492] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:05.383289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e454bf-9fcf-4438-9fc3-2b155f3cd54e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.383574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e454bf-9fcf-4438-9fc3-2b155f3cd54e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.383846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e454bf-9fcf-4438-9fc3-2b155f3cd54e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.389239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 248/493] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:05.389239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e454bf-9fcf-4438-9fc3-2b155f3cd54e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.408748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.413144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.472134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8db21-6dd2-4c78-884e-a0707ccf6c15 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.496284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e454bf-9fcf-4438-9fc3-2b155f3cd54e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.509802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.510737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.511185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.511627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.522520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:05.524102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:05.531977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed1713-aa7b-4ccd-b35d-ca18f7506bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.532625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1713-aa7b-4ccd-b35d-ca18f7506bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.532893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1713-aa7b-4ccd-b35d-ca18f7506bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.533166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1713-aa7b-4ccd-b35d-ca18f7506bc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:05.539933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:05.540777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:05.541677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:05.541677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:05.541677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:05.541677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:05.543353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed1713-aa7b-4ccd-b35d-ca18f7506bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:05.543750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 246/494] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:05.544794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c3ed1713-aa7b-4ccd-b35d-ca18f7506bc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:05.548553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:05.549432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:05.550246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 249/495] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:05.550898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589b41c-a230-4d18-9ae9-e749c01182fb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.556578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589b41c-a230-4d18-9ae9-e749c01182fb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.556578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589b41c-a230-4d18-9ae9-e749c01182fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.569431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e589b41c-a230-4d18-9ae9-e749c01182fb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:05.570609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e589b41c-a230-4d18-9ae9-e749c01182fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:05.644089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 250/496] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:05.644693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589b41c-a230-4d18-9ae9-e749c01182fb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.658196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.664029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.672874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd92fe-b569-4b09-9cde-580074901705 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.708901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.709595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.709878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.710157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.718846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:05.720322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:05.733817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:05.734753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 247/497] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:05.740221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.754790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589b41c-a230-4d18-9ae9-e749c01182fb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.792645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.793515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.794139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.794482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.795322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:05.795697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:05.797629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:05.811519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 251/498] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:05.812342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.851583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1badd-48cf-4e3a-8f70-08146bc1f2a2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.884152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.884783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.885065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.885373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.886091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:05.886394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:05.887780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:05.890532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.895929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 248/499] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:05.896482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:05.918427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:05.922427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b64ae-5181-425c-98bd-d2015502474b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:05.955578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:05.956245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:05.956526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:05.956808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:05.967033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:05.972010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:05.973044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:05.974048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 252/500] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:05.974825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.000415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7ba8c-c79d-4ce1-bbb8-f49fda3137d6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.033557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e41e4-be9c-4b2f-afed-15060a492cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.034258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e41e4-be9c-4b2f-afed-15060a492cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.034606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e41e4-be9c-4b2f-afed-15060a492cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.034886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e41e4-be9c-4b2f-afed-15060a492cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.035693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e41e4-be9c-4b2f-afed-15060a492cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:06.035994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e41e4-be9c-4b2f-afed-15060a492cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.037456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e41e4-be9c-4b2f-afed-15060a492cf6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.071052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccca67-1c48-46af-8190-44104f404fa3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.073465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 249/501] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:06.074762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a95334-6a9d-47db-9472-2db05514e594 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.075055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a95334-6a9d-47db-9472-2db05514e594 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.075332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a95334-6a9d-47db-9472-2db05514e594 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.080732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 250/502] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:06.080732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a95334-6a9d-47db-9472-2db05514e594 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.100601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.106985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.107667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.107946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.108215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.115627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.117103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:06.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:06.131343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:06.132225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 253/503] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:06.132769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.164822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.188140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a95334-6a9d-47db-9472-2db05514e594 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.222904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.223583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.223869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.224151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.230294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969b92-cd48-4c74-a1f9-2a0d78c5bab7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.234085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.237902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:06.250758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:06.251616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:06.252937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:06.252937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:06.252937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:06.252937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:06.252937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 251/504] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:06.252937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.269009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e88f-c600-4ec0-94e7-ef7308c4bb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.269693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e88f-c600-4ec0-94e7-ef7308c4bb3d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.269962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e88f-c600-4ec0-94e7-ef7308c4bb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.270236 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e88f-c600-4ec0-94e7-ef7308c4bb3d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.270961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e88f-c600-4ec0-94e7-ef7308c4bb3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:06.271267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e88f-c600-4ec0-94e7-ef7308c4bb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.272666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e88f-c600-4ec0-94e7-ef7308c4bb3d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.280547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 254/505] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:06.281721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc970-6cc2-4296-960f-8bac9f7414d3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.282012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc970-6cc2-4296-960f-8bac9f7414d3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.282287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc970-6cc2-4296-960f-8bac9f7414d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.299998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3c7cc970-6cc2-4296-960f-8bac9f7414d3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:06.301210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3c7cc970-6cc2-4296-960f-8bac9f7414d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:06.348246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.359261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7607d-00ff-4f4f-9655-de0aa2ffcbe4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.369222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 255/506] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:06.370074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc970-6cc2-4296-960f-8bac9f7414d3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.392269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.400052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.400677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.400950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.401226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.469779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc970-6cc2-4296-960f-8bac9f7414d3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.473308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.474774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.502787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.503414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.503692 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.503964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.504762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:06.505064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.506609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.541875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 256/507] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:06.542653 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.577227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 252/508] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:06.578165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.584331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.605780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.642155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e0f04-2b3a-4aac-8acd-9710be48a612 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.679107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.679301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da71f4-0bb2-4f66-8fd9-de44bc575aaf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.679731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.680010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.680287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.680988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:06.681303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.682718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.693779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 257/509] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:06.694575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.717726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.718395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.718677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.718951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.729052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.730499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:06.745141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:06.746136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:06.747519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:06.747519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:06.747519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:06.747519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:06.747519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 253/510] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:06.747519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.792095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.795218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b648c80-cee3-41d2-8097-3307eb113313 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.825973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:06.830693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.831345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.831628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.831903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.842718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.844211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.845633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc8fe-e3f5-42e0-ae29-615553a650e0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:06.858634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:06.859490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:06.860321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:06.860321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:06.860321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:06.860321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:06.860321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 258/511] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:06.860586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:06.885174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.885835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.886127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.886407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:06.954135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:06.955594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:06.958581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed2dd-170b-4591-addd-fd145a9db081 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:06.991041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:06.991631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:06.991872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:06.992142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.002688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.004159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:07.017873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:07.020102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:07.021167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:07.021167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:07.021167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:07.021167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:07.021167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 259/512] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:07.021167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.026233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.037914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.058719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 254/513] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:07.059648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.126657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325f11c-7e18-4102-a42a-c6512ca855dd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.157623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f050f0-330f-4392-b579-78b67ce3db4e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.159867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.160612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.160892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.161170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.168619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.170153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:07.181345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:07.182348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 260/514] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:07.188185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.192507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.193130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.193449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.193727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.194434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:07.194739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.196109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.207345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 255/515] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:07.208139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.246689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.252727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.285098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77963c35-4503-49df-ac49-53eadf348225 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.311053 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57376-f354-4e03-8683-0713d29f4e2c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.318972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.319598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.319881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.320157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.320856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:07.321162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.322623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.334191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 261/516] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:07.334975 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.346404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.347028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.347304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.347574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.348267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:07.348575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.349973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.361966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 256/517] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:07.362805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.431632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc6f21-8bb9-4007-bfd8-599d0fb2acfb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.454886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.461203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.464410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef0741-8fd5-45ee-b44e-145053402eef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.466756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.467400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.467677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.467945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.478060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.479546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:07.497251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:07.498309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:07.499371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:07.499371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:07.499371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:07.499371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:07.499623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 262/518] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:07.500608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.504790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.505441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.505723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.505998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.506786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:07.507091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.508519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.525746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 257/519] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:07.526594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.602636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bcda0-3fee-4403-bc91-c34e69566552 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.624034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87c22a-f5f4-4546-83b2-687ea79f3a4c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.634294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.634934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.635481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.635755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.643160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.644629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:07.656012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:07.657082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 263/520] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:07.658416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.662251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.662877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.663156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.663430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.664114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.665587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.687101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 258/521] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:19:07 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:07.687905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.705031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.718310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.792320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000896d-0565-454c-acbb-795069aa7f73 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.813742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903956-9af5-4763-9200-639d199ed7a4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.829166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.829865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.830152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.830427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.837992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.839540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:07.852931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:07.853856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 264/522] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:07.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.863821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:07.864561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:07.864904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:07.865244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:07.866023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:07.866330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:07.867709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:07.882450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 259/523] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:07.883234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:07.957090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.963173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ac228-28e0-40b7-9fc0-4c60b703f39f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:07.966112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:07.997655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960150b-c2ea-4cca-8873-4df8092fbd8c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.000114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.001583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.001871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.002153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.035136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.035796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.036124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.036412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.037225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:08.037567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.039061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.061112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 260/524] 10.222.0.47 () {56 vars in 1139 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:08.061112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.079073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.080640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.167460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb414d9-9b4a-44ee-ae75-132c7271471b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.177721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:08.185298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 265/525] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:08.186131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.206064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:08.212599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.213233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.213546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.213822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.214577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:08.214886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.216734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.245317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 261/526] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:08.246220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.294100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb3ed-f4c4-4666-bf4c-aee7714bd583 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.327947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.328523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.328804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.329079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.336007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.337524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:08.350313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:08.351360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:08.352395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:08.353249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 266/527] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:08.354106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.366232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb84ec-43a0-4767-91e8-cb8d7822a9ab None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.400226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.400851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.401130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.401435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.412576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:08.456938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e7bf-16f0-48c7-a74c-84ed776757eb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.467366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:08.478557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.480137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.492344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.492990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.493308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.493571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.507036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.508563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:08.523579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:08.524529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:08.525414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:08.525414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:08.525414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:08.525414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:08.525414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 267/528] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:08.525696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.584250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 262/529] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:08.585114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.632079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c36f6-61b3-4c33-85da-d3c91739b072 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.641365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:08.667514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.668360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.668785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.669203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.670252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=577eab0ae167408086ce9260a4f237e3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:08.670771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.672413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.678322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 268/530] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/role_assignments?user.id=577eab0ae167408086ce9260a4f237e3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:08.679144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.691534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:08.704993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b019209-314f-4e85-97af-5fad39cdabe4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.755301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.756081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.756495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.756773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.757796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:08.758123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.760766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.777481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 263/531] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:08.778456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.794964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4a4de-f4c7-44f1-9c8b-1e4c72066cea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.833333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.833988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.834325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.834542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.835312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:08.835623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.837039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.850907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 269/532] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:08.852167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.887865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:08.893529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f736-26c5-4af7-8884-74061f93de91 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.930403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:08.932020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:08.932406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:08.932808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:08.946192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:08.948317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:08.963740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bc896-e194-4c97-95f4-60aab360ed9a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:08.967458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:08.968486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:08.969582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:08.969582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:08.969582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:08.969582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:08.971131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 264/533] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:08.972443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:08.988014 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:09.003417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:09.004181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.004567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.004946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.005982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=fb625a81268d4067a59dbd34de4019cd) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:09.006464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:09.008045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:09.014313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 270/534] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/role_assignments?user.id=fb625a81268d4067a59dbd34de4019cd&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:09.015309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:09.103592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866b4c0-5b4c-4345-8aea-c21d60938e4d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:09.146128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:09.146864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.147154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.147479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.155888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:09.157471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:09.172487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:09.178745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:09.180032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 265/535] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:09.189318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:09.211818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:09.225132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb27c4-5a94-4310-b1f5-a31cbdcc39ad None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:09.280388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:09.301362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:09.302526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.303748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.304294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.305223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:09.305877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:09.307697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:09.327832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b0b9-8403-4125-b9ea-8b95133e19f4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:09.337345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 271/536] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:09.345491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:09.371916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:09.372450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.372780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.373331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.374163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:09.374593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:09.376110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:09.389588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 266/537] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:09.396395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:09.502647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559995d4-3a5a-4354-b17c-822556202c8b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:09.529724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:09.541707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:09.542465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.542843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.543217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.544126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=8436207924e742caafdc816b373fd40b) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:09.544589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:09.546219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:09.553809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 267/538] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:09 2022] GET /identity/v3/role_assignments?user.id=8436207924e742caafdc816b373fd40b&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:09.596997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2053-82c0-4a74-bf8e-547f73080171 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:09.638662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac59584-b18f-43a8-ba11-16393ef1e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:09.639243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59584-b18f-43a8-ba11-16393ef1e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.639518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59584-b18f-43a8-ba11-16393ef1e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.639787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59584-b18f-43a8-ba11-16393ef1e6b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.647320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac59584-b18f-43a8-ba11-16393ef1e6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:09.648869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac59584-b18f-43a8-ba11-16393ef1e6b1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-aac59584-b18f-43a8-ba11-16393ef1e6b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:09.662021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:09.662967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:09.663817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 272/539] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:09.669460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:09.736745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273cf5e-dd1b-416a-ae89-61dfcc6e50c0 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.737082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273cf5e-dd1b-416a-ae89-61dfcc6e50c0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.737316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273cf5e-dd1b-416a-ae89-61dfcc6e50c0 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.738807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 273/540] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:09.744276 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d0aa-f277-4a28-a48a-86e866ea6723 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.744806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d0aa-f277-4a28-a48a-86e866ea6723 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.745274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d0aa-f277-4a28-a48a-86e866ea6723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.787350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4822e-4c8f-4dab-ba3e-2ceb5ad30ae8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:09.798515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8589d0aa-f277-4a28-a48a-86e866ea6723 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:09.800119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8589d0aa-f277-4a28-a48a-86e866ea6723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:09.827268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:09.827905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:09.828187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:09.828461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:09.829227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:09.829565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:09.830828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:09.832738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:09.850577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 268/541] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:09.856573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:09.903471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 274/542] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:19:09.915340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:09.938778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589d0aa-f277-4a28-a48a-86e866ea6723 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:09.974133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d161-342d-4914-a316-3d577bc0a86a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:10.016499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:10.017394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:10.017807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:10.018236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:10.019172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=2929dcc2eee6498393466499b61d6ae6) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:10.019601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:10.021156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:10.028273 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 269/543] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:09 2022] GET /identity/v3/role_assignments?user.id=2929dcc2eee6498393466499b61d6ae6&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:10.127955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589d0aa-f277-4a28-a48a-86e866ea6723 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:10.180512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:10.181106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:10.181417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:10.181702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:10.198306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:10.203735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:10.204606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:10.205432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 275/544] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:10.211042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:10.345414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4ad3a-86d7-433f-a0e9-2a9531cd2194 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:10.359603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:10.382438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:10.383074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:10.383337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:10.383607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:10.384328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:10.384635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:10.386050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:10.395045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 270/545] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:10.400457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:10.414906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:10.522844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac359-2652-4339-9345-eee8635f5845 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:10.558477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:10.559137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:10.559418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:10.559687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:10.570620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:10.572195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:10.588218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:10.589095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:10.589987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:10.589987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:10.589987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:10.589987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:10.589987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 276/546] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:10.598070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:10.711473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507e89-d655-43fc-85d3-b121b7b5dc63 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:10.746359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:10.746983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:10.747261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:10.747535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:10.748294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:10.748599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:10.749999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:10.762404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 271/547] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:10.770661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:10.829959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:10.892210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a41ea-4105-4b27-b83c-5199545eda27 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:10.939358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b50707-9a42-4b42-abe5-7c0729a7970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:10.940019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50707-9a42-4b42-abe5-7c0729a7970e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:10.940303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50707-9a42-4b42-abe5-7c0729a7970e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:10.940582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50707-9a42-4b42-abe5-7c0729a7970e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:10.954387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b50707-9a42-4b42-abe5-7c0729a7970e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:10.955863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b50707-9a42-4b42-abe5-7c0729a7970e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a6b50707-9a42-4b42-abe5-7c0729a7970e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:10.971207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:10.972195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:10.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 277/548] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:10.978517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:11.037054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:11.072896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44ae3-5f44-43d1-a28c-5c0b6f79ad08 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.073225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44ae3-5f44-43d1-a28c-5c0b6f79ad08 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.073478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44ae3-5f44-43d1-a28c-5c0b6f79ad08 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.074848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 278/549] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:19:11.080698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc92368-dc9c-478a-8493-9607fbaf487f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.080916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc92368-dc9c-478a-8493-9607fbaf487f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.081193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc92368-dc9c-478a-8493-9607fbaf487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.103788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0cc92368-dc9c-478a-8493-9607fbaf487f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:11.105024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0cc92368-dc9c-478a-8493-9607fbaf487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:11.165095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e83bf2-fe1b-4c8b-a6a0-bec7a3c45bc3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:11.234207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 279/550] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:19:11.240279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:11.240966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.241255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.241571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.242414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:11.242725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:11.244191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:11.272969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 272/551] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Jul 29 08:19:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:11.274432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc92368-dc9c-478a-8493-9607fbaf487f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:11.278191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:11.337407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:11.392537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfecec-6d14-46ba-9b8c-71515bdaca9c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:11.428543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:11.429636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.429985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.430275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.438006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:11.441676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:11.448163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:11.449164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:11.450512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 273/552] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:11.455648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:11.471577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc92368-dc9c-478a-8493-9607fbaf487f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:11.520170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a295be-b35f-497c-8e96-392a8efcdef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:11.521116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a295be-b35f-497c-8e96-392a8efcdef3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.521781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a295be-b35f-497c-8e96-392a8efcdef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.522874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a295be-b35f-497c-8e96-392a8efcdef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.606573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a295be-b35f-497c-8e96-392a8efcdef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:11.608577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a295be-b35f-497c-8e96-392a8efcdef3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:11.611932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abb396-12d0-455e-9af8-38ddc2e82add None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:11.646587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0995d4-cb1a-4989-88cc-6cf1b16cbbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:11.647300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0995d4-cb1a-4989-88cc-6cf1b16cbbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.647648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0995d4-cb1a-4989-88cc-6cf1b16cbbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.647989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0995d4-cb1a-4989-88cc-6cf1b16cbbf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.648773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0995d4-cb1a-4989-88cc-6cf1b16cbbf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:11.649143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0995d4-cb1a-4989-88cc-6cf1b16cbbf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:11.650707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0995d4-cb1a-4989-88cc-6cf1b16cbbf2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:11.659554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 274/553] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:11.660382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:11.662048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb7223-dcfd-48ce-88a5-4e3fd047e513 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.662417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb7223-dcfd-48ce-88a5-4e3fd047e513 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.663785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb7223-dcfd-48ce-88a5-4e3fd047e513 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.664743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 275/554] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:11.665961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb7223-dcfd-48ce-88a5-4e3fd047e513 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:11.683579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:11.724030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 280/555] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:11.725679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516e773-6867-4a2d-9562-5d60ccf49a71 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.726222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516e773-6867-4a2d-9562-5d60ccf49a71 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.726643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516e773-6867-4a2d-9562-5d60ccf49a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.746459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9516e773-6867-4a2d-9562-5d60ccf49a71 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:11.748107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9516e773-6867-4a2d-9562-5d60ccf49a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:11.778823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb7223-dcfd-48ce-88a5-4e3fd047e513 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:11.814987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:11.815738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.816108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.816597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:11.824675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 281/556] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:11.826429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516e773-6867-4a2d-9562-5d60ccf49a71 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:11.829671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:11.831412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:11.848692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:11.849670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:11.850813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:11.850813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:11.850813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:11.850813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:11.850813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 276/557] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:11.859175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:11.925144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:11.933213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:11.950475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516e773-6867-4a2d-9562-5d60ccf49a71 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:11.971958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded3432-8145-4d45-96c9-215577146fd0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:11.987877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:11.988816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:11.989382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:11.989829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.001624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.003523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.008128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.008871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.009216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.009580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.010337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:12.010704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.012134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:12.020759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:12.022183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:12.023059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:12.023059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:12.023059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:12.023059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:12.025489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 277/558] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:12.029614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.029754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 282/559] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:12.030818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.146717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92edcff-1c8b-44d5-9ce1-84bbbf6515dd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.151316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212cfc-5f18-436a-b082-b8eb7d3f81d6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.174547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.183323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.184296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.184412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.184589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.184863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.193032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.194064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.194604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.195187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.198032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:12.203082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:12.204090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:12.204928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:12.207633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.209145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 278/560] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:12.210144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.210757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:12.227287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:12.228303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:12.229250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:12.232127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 283/561] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:12.233401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.316585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3528c55-054d-4c50-b502-0a247d6d937e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.351312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd52f-6366-4d41-9683-876444a6e117 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.352680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.353328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.353609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.353883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.354571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:12.354875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.356241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.367364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 279/562] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:12.368148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.384700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320eef1-8454-48a4-af79-12c8d3347c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.385359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320eef1-8454-48a4-af79-12c8d3347c17 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.385639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320eef1-8454-48a4-af79-12c8d3347c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.385909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320eef1-8454-48a4-af79-12c8d3347c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.386621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320eef1-8454-48a4-af79-12c8d3347c17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:12.386920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320eef1-8454-48a4-af79-12c8d3347c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.388356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320eef1-8454-48a4-af79-12c8d3347c17 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.396363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 284/563] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:12.397814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e32130-d717-43e8-bd43-29ce8314ff21 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.398007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e32130-d717-43e8-bd43-29ce8314ff21 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.398300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e32130-d717-43e8-bd43-29ce8314ff21 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.399486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 285/564] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:12.400483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef776-80a0-4597-9ef1-c03840361721 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.400761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef776-80a0-4597-9ef1-c03840361721 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.401014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef776-80a0-4597-9ef1-c03840361721 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.402408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 286/565] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:12.403147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef776-80a0-4597-9ef1-c03840361721 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.423714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.459348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.475797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6ced3-df16-43ae-9627-d9ad212b7235 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.507423 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef776-80a0-4597-9ef1-c03840361721 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.509984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.510604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.510885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.511727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.512530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:12.512838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.514381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.531581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 280/566] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:12.532378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.544761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755441ed-e5e3-459e-9a1d-532ef2704093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.545675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755441ed-e5e3-459e-9a1d-532ef2704093 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.545959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755441ed-e5e3-459e-9a1d-532ef2704093 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.546234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755441ed-e5e3-459e-9a1d-532ef2704093 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.552992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755441ed-e5e3-459e-9a1d-532ef2704093 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.554494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755441ed-e5e3-459e-9a1d-532ef2704093 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-755441ed-e5e3-459e-9a1d-532ef2704093 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:12.565979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:12.566853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:12.567773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 287/567] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:12.568308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d11136-897a-4be7-aa37-33716a57bd59 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.568707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d11136-897a-4be7-aa37-33716a57bd59 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.568861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d11136-897a-4be7-aa37-33716a57bd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.587422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-90d11136-897a-4be7-aa37-33716a57bd59 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:12.588641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-90d11136-897a-4be7-aa37-33716a57bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:12.639289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9961-8d8c-4557-907c-a8a584ab2b93 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.641595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.655132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 288/568] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:12.656307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2e54-9837-4d41-ac8a-a7931a36654e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.656591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2e54-9837-4d41-ac8a-a7931a36654e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.656861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2e54-9837-4d41-ac8a-a7931a36654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.673841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-089e2e54-9837-4d41-ac8a-a7931a36654e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:12.675016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-089e2e54-9837-4d41-ac8a-a7931a36654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:12.675221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.675860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.676142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.676420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.687025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.688483 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:12.703937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:12.705007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:12.706264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:12.706264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:12.706264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:12.706264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:12.706264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 281/569] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:12.707775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.717564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.752068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 289/570] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:12.753018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e2e54-9837-4d41-ac8a-a7931a36654e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.821638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138f596-2e10-4fba-8521-0c3dd4ce832a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.851018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e2e54-9837-4d41-ac8a-a7931a36654e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:12.854334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.854986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.855270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.855547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.866392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.867880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:12.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:12.883824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:12.884742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:12.884742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:12.884742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:12.884742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:12.884742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 282/571] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:12.885020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.889091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:12.889761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:12.890037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:12.890311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:12.891070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:12.891377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:12.892813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:12.898818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.911205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 290/572] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:12.912033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:12.943195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:12.987896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6187-cc57-4451-a561-37297829d319 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.012362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec06aa-4bef-487b-9920-c3697919bc0c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.021069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.021753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.022039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.022374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.032369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:13.037750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:13.038908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:13.039840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 283/573] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:13.040615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.049292 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.049951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.050241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.050519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.051221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:13.051525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.052928 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.064501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 291/574] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:13.067091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.110114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.145634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6451ca-12ed-4712-860f-68576aa4c255 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.158678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.168150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba1191-2a00-4a5d-9fcc-2fbb115166aa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.179881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.180549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.180815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.181103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.191203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:13.196595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:13.197676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:13.198659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 284/575] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:13.199502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.206192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.206814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.207090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.207363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.208052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:13.208352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.209780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.221722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 292/576] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:13.222491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.300950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35d57-a3ca-4aed-bb78-c27f76ce1c19 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.323732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914fe2-9146-4ba6-9a33-964b77153784 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.326947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.335830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.336523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.336805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.337078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.337894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e3ed5e24f863460ab8dea052bed1dac3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:13.338205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.339642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.352875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 285/577] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/role_assignments?user.id=e3ed5e24f863460ab8dea052bed1dac3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:13.352875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.359427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.360086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.360369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.360646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.361442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:13.361750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.363216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.377001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 293/578] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:13.377001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.391716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.477170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cd330-7342-4441-8df8-a3eee6ea0217 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.489832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbf7e5-93f5-4078-8b3c-57ac85e64e43 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.518650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.519300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.519580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.519860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.524741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.525561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.525984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.526421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.527293 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:13.527715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.527897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.529246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.529739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.538598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 294/579] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:13.539596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:13.540595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:13.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 08:19:13.542475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:13.546835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 286/580] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:13.547694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.604073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.624354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.654448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d26ef-a896-48e1-a5b9-40e2b528ee1a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.657680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a9db-e5b8-4f88-9dbb-6fc38064b6fe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.691365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.692174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.692577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.692734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.693035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.693409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.693691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.693967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.700997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.702487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.704550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.706089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:13.713782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:13.714890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 295/581] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:13.721531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:13.728872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:13.729776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:13.730781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:13.730781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:13.730781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:13.730781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:13.730781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 287/582] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:13.732170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.842191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56752d6-bf15-4492-97ea-b374c9355c68 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.842415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b6082-986a-4e8a-ab64-b7ca43812ac9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:13.845639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.878767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.878969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:13.879436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.879518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:13.879772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.879870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:13.879942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.880024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:13.880744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:13.881052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.882531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.883365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:13.892897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:13.894300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:13.908395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 288/583] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:13.908395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:13.919719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:13.920716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:13.926053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:13.926053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:13.926053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:13.926053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:13.926053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 296/584] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:13.926053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.020380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c164-1510-4cb7-a1a1-b50908560852 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.034674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65258-fa9a-4642-aac4-4f145f647a58 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.055660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.056469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.056809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.057229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.058071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:14.058436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.060102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.067540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.068194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.068473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.068802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.069541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:14.069842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.071230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.073597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 289/585] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:14.074573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.090030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 297/586] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:14.090832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.106178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.145966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.186919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd2a4a-98a3-451b-b668-9981ccaeb345 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.202109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1d564-d99b-4612-9e3a-6d0444da5f65 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.222072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.222802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.223154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.223534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.234580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.236110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.243736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.244822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.245168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.245604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.246304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:14.246607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.248759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:14.251118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:14.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:14.253203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:14.253203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:14.253203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:14.253203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:14.254072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 290/587] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:14.254590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.268131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 298/588] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:14.268131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.342371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.369033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1e2b-3822-48fa-a9b0-530ef2107e04 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.378831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019734cb-223b-42c5-b7ea-2e73dcc3071d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.388538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.408370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.409047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.409360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.409643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/577eab0ae167408086ce9260a4f237e3/roles/69363a3115984b76a7def98b3e959add` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.417259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.417956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.418236 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.418508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.427995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.428362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=577eab0ae167408086ce9260a4f237e3, role_id=69363a3115984b76a7def98b3e959add)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.429532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.430095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:14.442811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:14.443904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:14.444938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 299/589] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:14.446176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.457863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 291/590] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:14 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/577eab0ae167408086ce9260a4f237e3/roles/69363a3115984b76a7def98b3e959add => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:19:14.457863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.584319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df814df-bad2-4353-94c1-ed14a3e3ce77 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.598583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61b53c-d7ad-4143-80ad-b0e7e159e32f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.614505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.625607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.626464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.626754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.627042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.634616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.636267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.639791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.640419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.640696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.640970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.641695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:14.641994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.643364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:14.651071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:14.652076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:14.653650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 292/591] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:14.654636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.662142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 300/592] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:14.663006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.694115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.781543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d286-a635-40fc-a7c0-c7d583444b94 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.785956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d539e-46a7-4f05-83a8-291194ee37ea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.821484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.822293 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.822663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.823030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.823919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:14.824093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:14.824423 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.824720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:14.825002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:14.825289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:14.826172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:14.826459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.826581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:14.827868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:14.849734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 301/593] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:14.850764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.854663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 293/594] 10.222.0.47 () {56 vars in 1139 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:14.856581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:14.921828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.954047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:14.970825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2735f5-7c84-4a2e-98fd-79bec267c9cf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:14.972512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea9b5-3974-4f95-81e9-76d082fe64fb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.007304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.007979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.008259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.008529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.017935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.018856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.019034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.019189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.019387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.020471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.027135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.029710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:15.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:15.038082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:15.040182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:15.040182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:15.040182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:15.040182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:15.045331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 294/595] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:15.045541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:15.046683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:15.047791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:15.048338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.048432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 302/596] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:15.049308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.151207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:15.160580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a8473-4d78-41d0-baf7-bbbfe723cf33 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.174055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3f148-0e6d-4a85-bd7f-afab1754b29f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.208662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.209379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.209637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.209911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.214041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.214921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.215762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.216572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.217537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:15.218663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.220768 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.222002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.223517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.239095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 303/597] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:15.240296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:15.246296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:15.247199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:15.248239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:15.248239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:15.248239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:15.248239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:15.252153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 295/598] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:15.253101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.260182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:15.366700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a807411-cf01-406e-98ac-bf7bcb0bd8d7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.381183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d58bb-f891-43c5-b9c9-e4a16ad1fc46 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.402357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.402936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.403326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.403653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.411640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.413087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.414402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41662-8d0e-4734-9f8d-4b04da14285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.415030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41662-8d0e-4734-9f8d-4b04da14285f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.415312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41662-8d0e-4734-9f8d-4b04da14285f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.415596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41662-8d0e-4734-9f8d-4b04da14285f None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.416348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41662-8d0e-4734-9f8d-4b04da14285f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:15.416665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41662-8d0e-4734-9f8d-4b04da14285f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.418123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41662-8d0e-4734-9f8d-4b04da14285f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:15.425571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:15.426449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:15.427352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:15.433575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 296/599] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:15.433575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.433785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 304/600] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:15.433785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e954-ac98-4881-8560-c08aa3fb7a88 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.433785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e954-ac98-4881-8560-c08aa3fb7a88 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.433785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e954-ac98-4881-8560-c08aa3fb7a88 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.437494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 305/601] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:15.438279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e954-ac98-4881-8560-c08aa3fb7a88 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.444909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:15.509331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:15.545658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bd1e-7c01-4cbb-8f28-12021690ea48 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.551135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e954-ac98-4881-8560-c08aa3fb7a88 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.584211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.584847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.585443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.585443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.586195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:15.586456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.587838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.587955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd84f7c-84c8-44b7-a78c-0328124a95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.588486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd84f7c-84c8-44b7-a78c-0328124a95ca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.588769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd84f7c-84c8-44b7-a78c-0328124a95ca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.589046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd84f7c-84c8-44b7-a78c-0328124a95ca None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.589853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd84f7c-84c8-44b7-a78c-0328124a95ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:15.590528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd84f7c-84c8-44b7-a78c-0328124a95ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.592073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd84f7c-84c8-44b7-a78c-0328124a95ca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.606288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 297/602] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:15.606288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.610993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 306/603] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:15.612337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6b65-915c-4eda-8733-cd43164a37eb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.612632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6b65-915c-4eda-8733-cd43164a37eb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.612906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6b65-915c-4eda-8733-cd43164a37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.631135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cc7a6b65-915c-4eda-8733-cd43164a37eb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:15.632340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc7a6b65-915c-4eda-8733-cd43164a37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:15.675821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:15.713581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1dd15-331d-4c95-8714-73605f0b7d85 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.714457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 307/604] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:15.715774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6b65-915c-4eda-8733-cd43164a37eb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.756969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.757973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.758443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.758866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/fb625a81268d4067a59dbd34de4019cd/roles/69363a3115984b76a7def98b3e959add` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.777170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=fb625a81268d4067a59dbd34de4019cd, role_id=69363a3115984b76a7def98b3e959add)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.778934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.783601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:15.794438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 298/605] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:15 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/fb625a81268d4067a59dbd34de4019cd/roles/69363a3115984b76a7def98b3e959add => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:19:15.795238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.842078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6b65-915c-4eda-8733-cd43164a37eb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.879544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.880218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.880500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.880774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:15.889026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:15.890703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:15.903723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:15.904697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:15.905640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:15.909837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 308/606] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:15.910867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:15.938648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bfde-d261-4c7a-9048-92496efd1bf5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:15.963098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:15.989108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:15.990139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:15.990679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:15.991145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/8436207924e742caafdc816b373fd40b/roles/69363a3115984b76a7def98b3e959add` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.010013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=8436207924e742caafdc816b373fd40b, role_id=69363a3115984b76a7def98b3e959add)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:16.011512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:16.033365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 299/607] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:15 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/8436207924e742caafdc816b373fd40b/roles/69363a3115984b76a7def98b3e959add => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:19:16.034508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:16.040606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64d7d9-de3d-4d8d-bbb3-b7339266f569 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.064186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:16.090004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:16.091646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.092167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.092583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.107622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:16.114503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:16.115651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:16.116677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:16.120172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 309/608] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:16.126978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:16.166313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310310e0-7819-4ade-adae-2a19658c6a7b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.250251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fd8bc-d22b-4cd9-b879-cfd63c408537 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.252658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:16.254113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.254113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.254113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.255487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:16.255657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:16.257253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:16.273250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 300/609] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:16.279754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:16.296456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:16.297456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.297889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.298305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.299175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:16.299641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:16.301391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:16.311213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 310/610] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:16.316998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:16.320365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:16.375076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:16.452597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceff581-6744-4af7-ac92-a90139b778ed None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.488588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ce190-b9be-42a7-839f-8810fc59d340 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.528340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70f07-b860-407a-9f7f-88ced9cb8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:16.528965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70f07-b860-407a-9f7f-88ced9cb8719 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.529555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70f07-b860-407a-9f7f-88ced9cb8719 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.529825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70f07-b860-407a-9f7f-88ced9cb8719 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/2929dcc2eee6498393466499b61d6ae6/roles/69363a3115984b76a7def98b3e959add` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.546736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:16.547779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.548263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.548830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.549924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70f07-b860-407a-9f7f-88ced9cb8719 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=2929dcc2eee6498393466499b61d6ae6, role_id=69363a3115984b76a7def98b3e959add)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:16.551740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70f07-b860-407a-9f7f-88ced9cb8719 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:16.561686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:16.563530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:16.567949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 301/611] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:16 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/2929dcc2eee6498393466499b61d6ae6/roles/69363a3115984b76a7def98b3e959add => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:19:16.574663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08fb9c-9146-45c6-862a-5aa08f78d617 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.574663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08fb9c-9146-45c6-862a-5aa08f78d617 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.574663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08fb9c-9146-45c6-862a-5aa08f78d617 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.575821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 302/612] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:16.577917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e711c4-fb8d-4a4c-9e4b-b0e94cd86be7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.578317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e711c4-fb8d-4a4c-9e4b-b0e94cd86be7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.585352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e711c4-fb8d-4a4c-9e4b-b0e94cd86be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:16.607404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:16.608412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:16.609322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:16.609322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:16.609322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:16.609322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:16.614252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 311/613] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:16.618772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:16.620934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-41e711c4-fb8d-4a4c-9e4b-b0e94cd86be7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:16.631921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-41e711c4-fb8d-4a4c-9e4b-b0e94cd86be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:16.769717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 303/614] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:16.793078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:16.804685 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e711c4-fb8d-4a4c-9e4b-b0e94cd86be7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:16.807177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844bbb9-5727-4645-aef9-4afbf31f1c44 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.815104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:16.853226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:16.853922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.854204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.854471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.855154 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:16.855453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:16.856934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:16.871431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 312/615] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:16.876632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:16.934102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e711c4-fb8d-4a4c-9e4b-b0e94cd86be7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.971085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:16.971881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:16.972170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:16.972445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:16.986761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:16.991291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3e3c6-a4b5-47ba-a500-72a8bea248a5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:16.992842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:16.994750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:16.995617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 304/616] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:17.005201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.086045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.086712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.086989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.087158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:17.087310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:17.102434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:17.103907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:17.126871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:17.129036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:17.131341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 313/617] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:17.132707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1b42b-dfb4-499a-816f-5282bdd9fdcf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:17.138495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.167261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.167887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.168166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.168441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:17.169323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:17.169647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:17.170792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:17.171020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:17.181740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 305/618] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:17.190487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.336025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa55500-871c-4b50-9f55-0b98361cdede None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:17.372558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d083-3712-4b59-88a8-f0f254bcf417 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:17.393834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.394882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.395377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.396015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:17.397745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:17.398349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:17.399975 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:17.400892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:17.412896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.413968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.414319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.414662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:17.427312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:17.428880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:17.443291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 314/619] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:17.446012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:17.447896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:17.450124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:17.450124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:17.450124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:17.450124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:17.450124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 306/620] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:17.454422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.455827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.570973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78205ca6-4cb7-47fa-8c1c-2d2a0bc22576 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:17.592001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:17.616864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.618145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.618572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.618987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:17.631701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:17.633347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:17.649367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:17.650454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:17.651549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:17.651549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:17.651549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:17.651549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:17.654053 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 307/621] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:17.662731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.674225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc6263-c110-40b7-95ab-7a507d67515e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:17.696300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:17.753993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.754693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.754974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.755242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:17.755943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:17.756242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:17.757670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:17.778787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 315/622] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:17.781203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35acb3d-197a-4602-b351-b8a70014b5f0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:17.784827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.834914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.835680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.835962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.836238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:17.836965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:17.837270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:17.838680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:17.866797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 308/623] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:17.872586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:17.951930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de012f-adbf-4aae-8a68-967fc9e108b8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:17.979119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:17.994888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:17.995755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:17.996246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:17.996727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.016923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:18.018732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:18.043402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:18.044659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:18.045844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:18.051919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 316/624] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:18.053150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:18.061643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:18.072521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08252bee-776b-448e-8901-ea7fb4fe04d4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:18.120583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a09a7-f271-486c-a939-04332b2d14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:18.121384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a09a7-f271-486c-a939-04332b2d14df None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.121668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a09a7-f271-486c-a939-04332b2d14df None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.121940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a09a7-f271-486c-a939-04332b2d14df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.129739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a09a7-f271-486c-a939-04332b2d14df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:18.131359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a09a7-f271-486c-a939-04332b2d14df None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-aa0a09a7-f271-486c-a939-04332b2d14df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:18.145953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:18.146895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:18.147804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:18.148287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 309/625] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:18.149609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907719-1e68-44dd-9f37-4a24db36026d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.149896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907719-1e68-44dd-9f37-4a24db36026d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.150205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907719-1e68-44dd-9f37-4a24db36026d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.152504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 310/626] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:18.155721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78907719-1e68-44dd-9f37-4a24db36026d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:18.190092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df47d-6d37-48a2-a1af-277dc69f6a61 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:18.225582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e0f6-9b91-4e4c-aed0-7f4fbbcaf89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:18.226578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0f6-9b91-4e4c-aed0-7f4fbbcaf89d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.227058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0f6-9b91-4e4c-aed0-7f4fbbcaf89d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.227541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0f6-9b91-4e4c-aed0-7f4fbbcaf89d None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.228526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e0f6-9b91-4e4c-aed0-7f4fbbcaf89d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:18.229026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e0f6-9b91-4e4c-aed0-7f4fbbcaf89d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:18.230728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e0f6-9b91-4e4c-aed0-7f4fbbcaf89d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:18.249513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 317/627] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:19:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:18.251114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173dfca-dc4c-45fc-b54f-832d4dd516e0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.251627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173dfca-dc4c-45fc-b54f-832d4dd516e0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.252109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173dfca-dc4c-45fc-b54f-832d4dd516e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.268815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78907719-1e68-44dd-9f37-4a24db36026d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:18.281576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6173dfca-dc4c-45fc-b54f-832d4dd516e0 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:18.283479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6173dfca-dc4c-45fc-b54f-832d4dd516e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:18.307526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:18.308190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.308535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.308756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.309598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:18.310178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:18.311408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:18.331229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 311/628] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:18.332151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:18.346870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:18.349232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:18.384508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 318/629] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:18.385786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173dfca-dc4c-45fc-b54f-832d4dd516e0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:18.459774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50f03-133f-4cd2-9739-28821420f3b5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:18.495274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d81d-3648-4bf6-9da0-d90f6c3af72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:18.495848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d81d-3648-4bf6-9da0-d90f6c3af72b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.496133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d81d-3648-4bf6-9da0-d90f6c3af72b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.496412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d81d-3648-4bf6-9da0-d90f6c3af72b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.497000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173dfca-dc4c-45fc-b54f-832d4dd516e0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:18.533518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:18.533847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.534193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.534534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e3ed5e24f863460ab8dea052bed1dac3/roles/69363a3115984b76a7def98b3e959add` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.549986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=e3ed5e24f863460ab8dea052bed1dac3, role_id=69363a3115984b76a7def98b3e959add)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:18.551526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:18.564790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 319/630] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:18 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e3ed5e24f863460ab8dea052bed1dac3/roles/69363a3115984b76a7def98b3e959add => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:19:18.565418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:18.580588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845d81d-3648-4bf6-9da0-d90f6c3af72b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:18.583721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845d81d-3648-4bf6-9da0-d90f6c3af72b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:18.596687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:18.607019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:18.707684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968a130-ce08-4739-b7a8-81f4ee25389f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:18.736092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 312/631] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:18.738192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ef20-dc06-4d54-b3a5-aa3b6516b809 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.738485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ef20-dc06-4d54-b3a5-aa3b6516b809 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.739099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ef20-dc06-4d54-b3a5-aa3b6516b809 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.740513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 313/632] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:18.746541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ef20-dc06-4d54-b3a5-aa3b6516b809 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:18.746991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc30d2-4971-4b48-b3e6-8c836740d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:18.747736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc30d2-4971-4b48-b3e6-8c836740d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.748021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc30d2-4971-4b48-b3e6-8c836740d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.748298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc30d2-4971-4b48-b3e6-8c836740d0e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.760548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc30d2-4971-4b48-b3e6-8c836740d0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-21dc30d2-4971-4b48-b3e6-8c836740d0e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:18.765776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:18.766835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:18.767718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 320/633] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:18.768455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb575-6dff-41c9-9711-089aba04d0cc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.768728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb575-6dff-41c9-9711-089aba04d0cc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.769009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb575-6dff-41c9-9711-089aba04d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.786942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d4cbb575-6dff-41c9-9711-089aba04d0cc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:18.788147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d4cbb575-6dff-41c9-9711-089aba04d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:18.889305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 321/634] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:18.889305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb575-6dff-41c9-9711-089aba04d0cc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:18.892744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ef20-dc06-4d54-b3a5-aa3b6516b809 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:18.914951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:18.919780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:18.937769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:18.938426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:18.938715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:18.939034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:18.949818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:18.951343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:18.967223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:18.968184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:18.969084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:18.969084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:18.969084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:18.969084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:18.969084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 314/635] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:18.973994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.021656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb575-6dff-41c9-9711-089aba04d0cc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.059365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.060747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.061383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.061873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.062837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:19.063332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.065037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.074616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 322/636] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:19.075948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.080585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010717b-4ed0-406d-9325-74636af986c2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.117376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.118080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.118368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.118651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.129565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:19.135147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:19.136081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:19.136911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 315/637] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:19.137633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.179259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.184460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.207418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ae04-b0c8-427b-bdd9-39e781dacf0f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.246799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.247473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.247753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.248026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.248754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:19.249056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.250439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.267179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 323/638] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:19.267179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.275037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6352c-933d-4f54-abd1-c5961eeb6680 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.312473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3660f-5299-4dbc-8b53-4c38e91ea291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.313402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3660f-5299-4dbc-8b53-4c38e91ea291 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.313836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3660f-5299-4dbc-8b53-4c38e91ea291 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.314362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3660f-5299-4dbc-8b53-4c38e91ea291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.327438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3660f-5299-4dbc-8b53-4c38e91ea291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.328890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3660f-5299-4dbc-8b53-4c38e91ea291 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-24f3660f-5299-4dbc-8b53-4c38e91ea291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:19.343820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:19.344897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:19.345917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:19.345917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:19.345917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:19.345917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:19.349666 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 316/639] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:19.350928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028c24-6bca-4c76-9a85-44266782e52a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.351220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028c24-6bca-4c76-9a85-44266782e52a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.351496 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028c24-6bca-4c76-9a85-44266782e52a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.353314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 317/640] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:19.353867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028c24-6bca-4c76-9a85-44266782e52a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.382392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7302c-5c32-4eea-904f-17aaf37bb7e3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.422289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.422622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.422897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.423170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.423882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:19.424183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.425632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.431661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.438575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.444022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 324/641] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:19.444826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.465668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028c24-6bca-4c76-9a85-44266782e52a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.499934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33680e9a-b8cc-41ac-8b56-21b1b76d1566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.500574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33680e9a-b8cc-41ac-8b56-21b1b76d1566 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.500855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33680e9a-b8cc-41ac-8b56-21b1b76d1566 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.501133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33680e9a-b8cc-41ac-8b56-21b1b76d1566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.507986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33680e9a-b8cc-41ac-8b56-21b1b76d1566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.509464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33680e9a-b8cc-41ac-8b56-21b1b76d1566 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-33680e9a-b8cc-41ac-8b56-21b1b76d1566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:19.520879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:19.521924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 318/642] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac5c0f-8e0c-464d-99e0-6fd7a8d78a7d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.528097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac5c0f-8e0c-464d-99e0-6fd7a8d78a7d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.528835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac5c0f-8e0c-464d-99e0-6fd7a8d78a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.544259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9bac5c0f-8e0c-464d-99e0-6fd7a8d78a7d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:19.545747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9bac5c0f-8e0c-464d-99e0-6fd7a8d78a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:19.557754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90172-b04f-49f0-b6a1-f1a118ab02ee None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.595867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.596803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.597261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.597627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.598387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:19.598758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.600214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.612286 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 325/643] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:19.613231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.625419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 319/644] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:19.626438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac5c0f-8e0c-464d-99e0-6fd7a8d78a7d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.676384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.697481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.721228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf08a-dc56-4201-bee8-d60197f10087 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.738093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac5c0f-8e0c-464d-99e0-6fd7a8d78a7d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.758921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.759561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.759838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.760121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.771663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.773196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.774396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.775018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.775303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.775566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.776335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:19.776643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.778164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:19.788450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:19.789635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:19.795417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:19.795417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:19.795417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:19.795417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:19.795417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 326/645] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:19.795417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.795790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 320/646] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:19.795790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.896221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c80f56-0ea0-4566-b043-14cf97ec6d91 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.897689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5dfcc-10e1-4f10-ac51-4931293c706b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:19.910384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.923582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:19.932743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.932902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:19.933412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.933579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:19.933689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.933851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:19.933953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.934100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:19.941392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:19.942853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:19.944694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:19.950612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:19.951527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:19.952361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:19.953872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:19.954771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 08:19:19.956994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:19.958465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 321/647] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:19.958465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:19.959772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 327/648] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:19.960591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.063770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdea3-1ffe-44ae-93f5-388f1f132a5d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.065993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297e17f-934b-4950-abd9-27d59124e557 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.099102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.099727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.100010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.100285 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.100590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.100968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:20.101235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.101360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.101542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.101808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.102590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=577eab0ae167408086ce9260a4f237e3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:20.102694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.103015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.104450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.121323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 328/649] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/role_assignments?user.id=577eab0ae167408086ce9260a4f237e3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:20.121323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.129491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 322/650] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:20.130472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.157237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:20.202312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:20.238233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029c31d-b3ae-4f77-bd6d-d2034fd973c2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.279274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.280078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.280450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.280821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.281690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:20.281820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5b044-6d8c-4044-a17e-f55f100b2173 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.282184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.283808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.294313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 329/651] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:20.298946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.333046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.334091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.334650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.335077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.336038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:20.336648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.339098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.360960 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 323/652] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:20.365314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.421389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:20.433502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c4c5d-2f0b-463a-9530-8f48b55a043c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.474197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505011-4bef-4054-8769-5c8e46374ab6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.475266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.476178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.476460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.476733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.478004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:20.489167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.491088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:20.511064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:20.512211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:20.513192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 330/653] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:20.517234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.518508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06362024-a096-44c7-8463-541f087194bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.519176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06362024-a096-44c7-8463-541f087194bd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.519453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06362024-a096-44c7-8463-541f087194bd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.519732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06362024-a096-44c7-8463-541f087194bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.534863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06362024-a096-44c7-8463-541f087194bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.536497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06362024-a096-44c7-8463-541f087194bd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-06362024-a096-44c7-8463-541f087194bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:20.551866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:20.552812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:20.553736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:20.553736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:20.553736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:20.553736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:20.553736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 324/654] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:20.554561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06362024-a096-44c7-8463-541f087194bd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.628578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26676c67-e7ec-4d1c-beae-ec3248eddbff None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.663269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37b57f-ed0e-44cb-9e3f-eb7fee1747d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.664046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b57f-ed0e-44cb-9e3f-eb7fee1747d8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.664422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b57f-ed0e-44cb-9e3f-eb7fee1747d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.664795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b57f-ed0e-44cb-9e3f-eb7fee1747d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.669820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06362024-a096-44c7-8463-541f087194bd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.693681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:20.708118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.708849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.709200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.709561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.710793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:20.711171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.713322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.736111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 325/655] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:20.737019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.743484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37b57f-ed0e-44cb-9e3f-eb7fee1747d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.744962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37b57f-ed0e-44cb-9e3f-eb7fee1747d8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.754452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:20.849615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ebf07-25b3-4577-8302-a5055168827d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.864341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 331/656] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:20.864341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77ddd-6ecc-4970-9062-d86d04449bac None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.864341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77ddd-6ecc-4970-9062-d86d04449bac None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.864341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77ddd-6ecc-4970-9062-d86d04449bac None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.869320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 332/657] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:20.869320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe77ddd-6ecc-4970-9062-d86d04449bac None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.889427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:20.890104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:20.890390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:20.890661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:20.891353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:20.891662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:20.893031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:20.909520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 326/658] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:20.909520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:20.935452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:20.980245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe77ddd-6ecc-4970-9062-d86d04449bac None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:20.985836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.012264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8728-c0b1-4d60-bf71-e98daa08763c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.017594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.018348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.018722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.019213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.045472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149961d-da2d-49c9-b424-23ce86330948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.046201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149961d-da2d-49c9-b424-23ce86330948 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.046566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149961d-da2d-49c9-b424-23ce86330948 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.046913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149961d-da2d-49c9-b424-23ce86330948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.057507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149961d-da2d-49c9-b424-23ce86330948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.058966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149961d-da2d-49c9-b424-23ce86330948 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d149961d-da2d-49c9-b424-23ce86330948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:21.073641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:21.074676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:21.075612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:21.075612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:21.075612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:21.075612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:21.075612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 327/659] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:21.075975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bd6b-5d5a-42b5-8b58-d126f968b148 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.076233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bd6b-5d5a-42b5-8b58-d126f968b148 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.076512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bd6b-5d5a-42b5-8b58-d126f968b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.094095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e134bd6b-5d5a-42b5-8b58-d126f968b148 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:21.095293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e134bd6b-5d5a-42b5-8b58-d126f968b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:21.097565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.099278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.164780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.170134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 328/660] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:21.171040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bd6b-5d5a-42b5-8b58-d126f968b148 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.223433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 333/661] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:21.224635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.236257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.291272 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bd6b-5d5a-42b5-8b58-d126f968b148 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.329327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.329562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33813-6437-4718-af99-b63fb7220117 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.329988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.329988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.329988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.337933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.339392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:21.351930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:21.352992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 329/662] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:21.354522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.373888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.374526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.374799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.375298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.375780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:21.376080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.377517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.389582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 334/663] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:21.394424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.417515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.463523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12918f-fea0-40cc-a01c-6b518b17d6ca None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.481122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.505361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.506041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.506324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.506600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.518418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:21.523750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:21.524752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:21.526142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:21.529818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 330/664] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:21.530287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac851f-f8c8-4e90-994e-0f2b8e3e9226 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.530735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.567298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.568487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.568487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.568487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.579131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.580870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:21.595230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:21.596173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:21.597061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:21.597061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:21.597061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:21.597061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:21.597061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 335/665] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:21.598091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.659321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343cb0-0898-4147-8398-0fd8c65bb8b0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.677559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.704449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.705298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.705768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.706138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.707040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:21.707444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.709188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.712105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4116a-f6ab-414f-aad2-5bbe53a15830 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.732874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 331/666] 10.222.0.47 () {56 vars in 1139 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:21.734244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.757958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e449-a885-476e-951c-362c5b48435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.758491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e449-a885-476e-951c-362c5b48435a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.758748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e449-a885-476e-951c-362c5b48435a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.759195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e449-a885-476e-951c-362c5b48435a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.766275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e449-a885-476e-951c-362c5b48435a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.767824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e449-a885-476e-951c-362c5b48435a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.778571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0784e449-a885-476e-951c-362c5b48435a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:21.781137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:21.782234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:21.783327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:21.788941 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 336/667] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:21.788941 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e449-a885-476e-951c-362c5b48435a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.861121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c1316-3f26-48d6-b7e6-5710a6d1ac3e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.914189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.914820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.915106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.915385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.916112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:21.916415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.917846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.917955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e449-a885-476e-951c-362c5b48435a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:21.930911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 332/668] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:21.930911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:21.957991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:21.967232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:21.967856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:21.968130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:21.968403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:21.969064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:21.969827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:21.971542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:21.986780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 337/669] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:21.987697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.033368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.040669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939daf5-309f-47d4-b961-0f5850088afd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.077991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.078709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.078891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.079167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.092806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53784432-71d1-4268-a35e-ab792bfbb47c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.129756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.130409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.130691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.130969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.131720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:22.132030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.133515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.149910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 338/670] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:22.149910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.154528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.156068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.201633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.254998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.260830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b18d-acaa-4f7d-9376-0be0d82f36dc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.263749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 333/671] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:22.264134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.296746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.297427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.297720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.297988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.308393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.309977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:22.323985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:22.325111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:22.326219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:22.326219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:22.326219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:22.326219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:22.326219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 339/672] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:22.326219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.367188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd665d88-4f2a-43cc-a870-9bc0e341330c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.400543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8898e2-28a6-4046-91ba-28c88289900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.401187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8898e2-28a6-4046-91ba-28c88289900d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.401495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8898e2-28a6-4046-91ba-28c88289900d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.401769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8898e2-28a6-4046-91ba-28c88289900d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.408508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8898e2-28a6-4046-91ba-28c88289900d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.410007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8898e2-28a6-4046-91ba-28c88289900d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.421933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc281-b1cb-4c59-b4de-aeec6a4e292a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fa8898e2-28a6-4046-91ba-28c88289900d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:22.422414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:22.423356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:22.424265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 334/673] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:22.424758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd939e-1353-4365-a572-0b1d962d0a7a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.424833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd939e-1353-4365-a572-0b1d962d0a7a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.425084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd939e-1353-4365-a572-0b1d962d0a7a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.426578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 335/674] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:22.427159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd939e-1353-4365-a572-0b1d962d0a7a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.428696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.460364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.460908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.461188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.461490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.462285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=fb625a81268d4067a59dbd34de4019cd) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:22.462593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.464046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.470485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 340/675] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/role_assignments?user.id=fb625a81268d4067a59dbd34de4019cd&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:22.471241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.485831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.540607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd939e-1353-4365-a572-0b1d962d0a7a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.581929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ee8f-181e-44ee-b9d4-f36e1b310687 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.582910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.583592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.583880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.584160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.596610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.598179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:22.614648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:22.615827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:22.616723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:22.616723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:22.616723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:22.616723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:22.616723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 336/676] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:22.616723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.626644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603004d-b65b-4efd-b3a8-1945f6b28724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.627283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603004d-b65b-4efd-b3a8-1945f6b28724 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.627562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603004d-b65b-4efd-b3a8-1945f6b28724 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.627836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603004d-b65b-4efd-b3a8-1945f6b28724 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.628884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603004d-b65b-4efd-b3a8-1945f6b28724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:22.628884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603004d-b65b-4efd-b3a8-1945f6b28724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.630275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603004d-b65b-4efd-b3a8-1945f6b28724 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.644486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 341/677] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:22.646337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09ccc-3175-495d-b0bf-a44a8fb67c00 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.646627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09ccc-3175-495d-b0bf-a44a8fb67c00 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.646906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09ccc-3175-495d-b0bf-a44a8fb67c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.667334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dcd09ccc-3175-495d-b0bf-a44a8fb67c00 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:22.667334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dcd09ccc-3175-495d-b0bf-a44a8fb67c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:22.689508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.733017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f1469-8570-4ebb-b5d0-6ccae981e556 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.749308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 342/678] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:22.749308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09ccc-3175-495d-b0bf-a44a8fb67c00 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.750971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.781371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.782075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.782421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.782572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.783582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:22.784737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.786250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.801209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 337/679] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:22.802099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.866891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09ccc-3175-495d-b0bf-a44a8fb67c00 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.910219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a26821-12f2-4e00-9051-e46e8f334923 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:22.910437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.910848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.911110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.911391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.912077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:22.912374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.913795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.929415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 343/680] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:22.929415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:22.944712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:22.955477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:22.956120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:22.956406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:22.956684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:22.964012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:22.965916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:22.977713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:22.978678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 338/681] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:22.984764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.014108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:23.041579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e31c95-2789-45ab-ac95-8ff3f39dfa9c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.079905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.080558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.080840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.081114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.088629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750b245-9595-41c4-aa54-34bbe74dbf17 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.092219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:23.097594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:23.098535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:23.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 344/682] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:23.100183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.128336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.129451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.130047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.130394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.131199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=8436207924e742caafdc816b373fd40b) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:23.131514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.133052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.149371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 339/683] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:22 2022] GET /identity/v3/role_assignments?user.id=8436207924e742caafdc816b373fd40b&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:23.149371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.192853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:23.221778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5361-3b93-4394-9fe9-4480cc8b8e7d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.272139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.273003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.273388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.273738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.282715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.284383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:23.298405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:23.299619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:23.300719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:23.302779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 345/684] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:23.303749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.412973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:23.422828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd4f4e-e766-407a-aa91-00ae3ba62aa1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.427175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53d60-e615-43ab-ae58-d0660d400e31 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.460786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.461607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.461957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.462297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.463091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:23.463465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.469336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.473889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.474593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.474827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:23.474930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.475281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.476176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:23.476593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.478125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.489257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 346/685] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:23.490417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.502568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 340/686] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:23.504021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.601716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f0c8-4d25-455e-a039-2514d7593cb3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.609154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13f89-2cfb-4712-bb0f-054f0f9391b3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.645157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.645429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.645998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.646106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.646285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.646395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.646564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.646702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.647342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:23.647653 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.649313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.658269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.659919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.669071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 347/687] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:23.670038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:23.677605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:23.678679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:23.679702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:23.679702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:23.679702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:23.679702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:23.681508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 341/688] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:23.682447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.686717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:23.756327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:23.798159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618bb7-57d3-4b80-99fc-c8b0a8680708 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.802283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe88fcf-22f6-44f1-9e25-704adb60ba7b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:23.836139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.836871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.837386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.837765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.841356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:23.842150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:23.843319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:23.843766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:23.844713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=2929dcc2eee6498393466499b61d6ae6) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:23.845170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.846767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.861403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 342/689] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/role_assignments?user.id=2929dcc2eee6498393466499b61d6ae6&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:23.861403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:23.973752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:23.975270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:23.995759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:24.058352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3211-1c78-4519-ac44-d195c807b9b0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:24.088095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:24.104351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:24.105257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.105759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.106242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.107117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:24.107610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:24.109256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:24.123448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 343/690] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:24.128979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:24.148399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 348/691] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:24.156454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:24.264365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a719e5b-d48b-49e5-b090-ca7797b7217b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:24.289944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0ce8c-3328-4e0c-ab24-5028230c27b3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:24.291938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:24.301175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:24.302688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.302688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.302688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.312662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:24.315102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:24.325767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:24.326420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.326700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.326973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:24.330404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:24.331428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:24.332396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 344/692] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:19:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:24.341617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:24.345407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:24.346895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:24.372113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:24.373096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:24.374088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:24.374088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:24.374088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:24.374088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:24.374088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 349/693] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:24.382603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:24.399848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:24.456451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ac878-f2c1-448a-b84e-86363f3dba47 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:24.519910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:24.520597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.520884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.521162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.522004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:24.522314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:24.523813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:24.558463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 345/694] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:19:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:24.559986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:24.562798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c06cb-e90d-4c71-9efe-895597586d7c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:24.608741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b5f66-ba74-45b9-8f1d-0e3e2a870939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:24.609399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5f66-ba74-45b9-8f1d-0e3e2a870939 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.609680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5f66-ba74-45b9-8f1d-0e3e2a870939 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.609959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5f66-ba74-45b9-8f1d-0e3e2a870939 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.610745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b5f66-ba74-45b9-8f1d-0e3e2a870939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:24.611053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b5f66-ba74-45b9-8f1d-0e3e2a870939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:24.612544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b5f66-ba74-45b9-8f1d-0e3e2a870939 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:24.624777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:24.625891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 350/695] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:24.627158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2aefc-6487-48c6-bf22-5b9234791078 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.627438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2aefc-6487-48c6-bf22-5b9234791078 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.627710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2aefc-6487-48c6-bf22-5b9234791078 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.633124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 351/696] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:24.633937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2aefc-6487-48c6-bf22-5b9234791078 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:24.686126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193378f8-449b-4e58-bfb9-5c896e4bbc5a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:24.729689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:24.732341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:24.733022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.733334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.733622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.769542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2aefc-6487-48c6-bf22-5b9234791078 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:24.808658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:24.810816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:24.820459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf71c56-1c86-40d4-ac55-531617724651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:24.821861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71c56-1c86-40d4-ac55-531617724651 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.822776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71c56-1c86-40d4-ac55-531617724651 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.823402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71c56-1c86-40d4-ac55-531617724651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.832505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf71c56-1c86-40d4-ac55-531617724651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:24.834793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf71c56-1c86-40d4-ac55-531617724651 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9cf71c56-1c86-40d4-ac55-531617724651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:24.851142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:24.852100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:24.852999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:24.859533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 352/697] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:24.860931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada27bd-2ac2-400c-a868-2995e5af97aa None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:24.861274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada27bd-2ac2-400c-a868-2995e5af97aa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:24.861597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada27bd-2ac2-400c-a868-2995e5af97aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:24.862240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:24.881550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eada27bd-2ac2-400c-a868-2995e5af97aa None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:24.882730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eada27bd-2ac2-400c-a868-2995e5af97aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:24.933773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 346/698] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:24.935203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.047085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9787821-6095-4968-9c08-54e1cb9f551b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.080838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 353/699] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:25.082078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada27bd-2ac2-400c-a868-2995e5af97aa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.105679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.106429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.106715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.106994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.107804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:25.108116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.111380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.124265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 347/700] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:25.125125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.134130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:25.163655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:25.214535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada27bd-2ac2-400c-a868-2995e5af97aa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.251084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad77c-ee85-4c81-8ebd-46ceaed68d44 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.255582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.256106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.256492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.256854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.269131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.270833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:25.287681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:25.288810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:25.289934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:25.289934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:25.289934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:25.289934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:25.291420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 354/701] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:25.292372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.293883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.294750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.295167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.295747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.307275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.308955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:25.326147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:25.327172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:25.328107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:25.328107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:25.328107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:25.328107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:25.334938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 348/702] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:25.336625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.397301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:25.400437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071e1d5-a880-4a89-96c1-7e96871b985d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.414856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:25.437855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.438735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.439116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.439494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.440389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e3ed5e24f863460ab8dea052bed1dac3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:25.440820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.442608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.448116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932aaf1-a0bb-4ba2-81db-c85f4a1f8cc2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.449319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 355/703] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/role_assignments?user.id=e3ed5e24f863460ab8dea052bed1dac3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:25.450374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.490022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fe256-fef3-4559-9d8d-fd38ec343c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.490973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe256-fef3-4559-9d8d-fd38ec343c50 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.491254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe256-fef3-4559-9d8d-fd38ec343c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.491535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe256-fef3-4559-9d8d-fd38ec343c50 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.492227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fe256-fef3-4559-9d8d-fd38ec343c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:25.492532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fe256-fef3-4559-9d8d-fd38ec343c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.493957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fe256-fef3-4559-9d8d-fd38ec343c50 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.511910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 349/704] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:25.513593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f929e-8eb5-4a02-aa51-bdb75fa343cd None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.513888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f929e-8eb5-4a02-aa51-bdb75fa343cd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.514159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f929e-8eb5-4a02-aa51-bdb75fa343cd None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.515628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 350/705] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:25.517444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f929e-8eb5-4a02-aa51-bdb75fa343cd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.577667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e271-ee56-44c2-a70a-0350d2e83a60 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.623829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99351c14-bca3-4606-b30f-5a1ff0e027b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.624470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99351c14-bca3-4606-b30f-5a1ff0e027b9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.624746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99351c14-bca3-4606-b30f-5a1ff0e027b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.625031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99351c14-bca3-4606-b30f-5a1ff0e027b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.626140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99351c14-bca3-4606-b30f-5a1ff0e027b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:25.626140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99351c14-bca3-4606-b30f-5a1ff0e027b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.627498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99351c14-bca3-4606-b30f-5a1ff0e027b9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.642036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 356/706] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:25.642036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de904-7d79-4708-9596-66e90008e31a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.642298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de904-7d79-4708-9596-66e90008e31a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.642547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de904-7d79-4708-9596-66e90008e31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.650741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f929e-8eb5-4a02-aa51-bdb75fa343cd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.664826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bb9de904-7d79-4708-9596-66e90008e31a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:25.666108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bb9de904-7d79-4708-9596-66e90008e31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:25.670684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:25.697114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.697818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.698106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.698497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.700778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:25.707625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.709086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:25.723280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:25.724237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 351/707] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:25.725850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.753893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 357/708] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:25.755253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9de904-7d79-4708-9596-66e90008e31a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.853919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4161442-92c5-48a9-8f9c-e6d85f8b4a31 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.874391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9de904-7d79-4708-9596-66e90008e31a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:25.890371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.891361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.891838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.892319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.893189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.894879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.922011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 352/709] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:19:25 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:25.923237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.933331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:25.936797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:25.938349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:25.938872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:25.942783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:25.943410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:25.945111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:25.968978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 358/710] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:25.975576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:25.999861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:26.034329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:26.115812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17679a4-e67d-4009-9ed7-8d6be0549428 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:26.141076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d742-eafb-4636-becf-b30b1f8358da None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:26.164095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:26.164817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.165166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.165558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.166429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=577eab0ae167408086ce9260a4f237e3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:26.166810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:26.168847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:26.178718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 359/711] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/role_assignments?user.id=577eab0ae167408086ce9260a4f237e3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:26.189810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1d62e-4e45-4199-bc63-fd29e7aafb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:26.190782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d62e-4e45-4199-bc63-fd29e7aafb9c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.191194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d62e-4e45-4199-bc63-fd29e7aafb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.191609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d62e-4e45-4199-bc63-fd29e7aafb9c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.192438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1d62e-4e45-4199-bc63-fd29e7aafb9c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:26.194133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1d62e-4e45-4199-bc63-fd29e7aafb9c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-11f1d62e-4e45-4199-bc63-fd29e7aafb9c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:26.207788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:26.209067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:26.210134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:26.212886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 353/712] 10.222.0.47 () {56 vars in 1129 bytes} [Fri Jul 29 08:19:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:26.219666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:26.290816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861141b-7194-4ad5-ac57-d61013f9df9c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.291458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861141b-7194-4ad5-ac57-d61013f9df9c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.291883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861141b-7194-4ad5-ac57-d61013f9df9c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.293741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 354/713] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:26.299940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ba9a-0fe0-4c27-b436-e0a72a3b74df None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.300460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ba9a-0fe0-4c27-b436-e0a72a3b74df None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.301005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ba9a-0fe0-4c27-b436-e0a72a3b74df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.322808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6963ba9a-0fe0-4c27-b436-e0a72a3b74df None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:26.324598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6963ba9a-0fe0-4c27-b436-e0a72a3b74df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:26.351998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:26.362176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79bbb8-85e6-4320-b219-1862af193857 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:26.398001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:26.398662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.398976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.399214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.399917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:26.400223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:26.401647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:26.406923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 360/714] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Jul 29 08:19:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:26.407382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 355/715] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:19:26.412092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:26.429428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963ba9a-0fe0-4c27-b436-e0a72a3b74df None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:26.459414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:26.513332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbbb0b-fa1a-4b12-b7b7-a7dfedba50b2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:26.536118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963ba9a-0fe0-4c27-b436-e0a72a3b74df None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:26.549633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:26.550276 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.550560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.550839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.551531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:26.551843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:26.553263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:26.559821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 361/716] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Jul 29 08:19:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:26.575892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:26.576971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.577510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.577990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] PATH_INFO: `/v3/services/network` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.578867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:26.580467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:26.591263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:26.592415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:26.593303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:26.596253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 356/717] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:26 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:26.602631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:26.647181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:26.735140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c5d87-b9b8-4c7b-8c6f-f41e84956396 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:26.772085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3bfe-1d7e-441d-8200-d8a23ff23b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:26.772731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3bfe-1d7e-441d-8200-d8a23ff23b9d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.773016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3bfe-1d7e-441d-8200-d8a23ff23b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.773310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3bfe-1d7e-441d-8200-d8a23ff23b9d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.774017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3bfe-1d7e-441d-8200-d8a23ff23b9d None admin] RBAC: Adding query filter params (name=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:26.774326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3bfe-1d7e-441d-8200-d8a23ff23b9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:26.775754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3bfe-1d7e-441d-8200-d8a23ff23b9d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:26.781402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 362/718] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:26.790780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:26.896087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:26.908997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9dce0-a0aa-45b1-ae18-4ea2777417cf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:26.944054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4a642-0597-4ecf-bfc0-b8f9ea3d3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:26.945045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a642-0597-4ecf-bfc0-b8f9ea3d3917 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:26.945556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a642-0597-4ecf-bfc0-b8f9ea3d3917 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:26.946032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a642-0597-4ecf-bfc0-b8f9ea3d3917 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:26.946942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4a642-0597-4ecf-bfc0-b8f9ea3d3917 None admin] RBAC: Adding query filter params (type=network) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:26.947474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4a642-0597-4ecf-bfc0-b8f9ea3d3917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:26.949039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4a642-0597-4ecf-bfc0-b8f9ea3d3917 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:26.957388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 357/719] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:27.807420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839522a-2c05-4e10-b289-feee2dfd1ed9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:27.808341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839522a-2c05-4e10-b289-feee2dfd1ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:27.808764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839522a-2c05-4e10-b289-feee2dfd1ed9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:27.810610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 363/720] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:27.816128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0afbeb-c715-4d6b-8346-1ab92b06d99d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:27.816646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0afbeb-c715-4d6b-8346-1ab92b06d99d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:27.817143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0afbeb-c715-4d6b-8346-1ab92b06d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:27.842703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6b0afbeb-c715-4d6b-8346-1ab92b06d99d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:27.844172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6b0afbeb-c715-4d6b-8346-1ab92b06d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:27.930790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 358/721] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 08:19:27.962588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839522a-2c05-4e10-b289-feee2dfd1ed9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:28.074251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:28.093876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839522a-2c05-4e10-b289-feee2dfd1ed9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:28.126814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:28.127464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.127740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.128008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.138336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:28.143842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:28.144795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:28.145677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 364/722] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:28.158455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0afbeb-c715-4d6b-8346-1ab92b06d99d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:28.270604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:28.292950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0afbeb-c715-4d6b-8346-1ab92b06d99d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:28.341128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:28.341788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.342069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.342393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.343116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:28.343420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:28.344992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:28.353588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 359/723] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:28.362417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:28.496443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cba89e-9319-4528-8394-0fde5dbc202e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:28.533844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b512c-7425-4a3a-bf9f-3b8163c42a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:28.534486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b512c-7425-4a3a-bf9f-3b8163c42a63 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.534761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b512c-7425-4a3a-bf9f-3b8163c42a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.535041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b512c-7425-4a3a-bf9f-3b8163c42a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.550316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b512c-7425-4a3a-bf9f-3b8163c42a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:28.551809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b512c-7425-4a3a-bf9f-3b8163c42a63 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:28.553693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-682b512c-7425-4a3a-bf9f-3b8163c42a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:28.571051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:28.571994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:28.572963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:28.572963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:28.572963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:28.572963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:28.572963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 365/724] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:28.579362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:28.690311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d2e7-5a34-4c0c-8922-abfb4a976d92 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.690499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d2e7-5a34-4c0c-8922-abfb4a976d92 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.690785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d2e7-5a34-4c0c-8922-abfb4a976d92 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.692274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 366/725] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:28.697474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ccad0-0c55-4761-9d47-3306987d9609 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.697755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ccad0-0c55-4761-9d47-3306987d9609 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.698040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ccad0-0c55-4761-9d47-3306987d9609 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.699483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 367/726] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:19:28.700554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b15b4b-6467-4ea1-b341-90336e014700 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.700913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b15b4b-6467-4ea1-b341-90336e014700 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.701110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b15b4b-6467-4ea1-b341-90336e014700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.727630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c1b15b4b-6467-4ea1-b341-90336e014700 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:28.728849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c1b15b4b-6467-4ea1-b341-90336e014700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:28.740864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551425a1-cb62-4fa4-aa68-273ede7d3588 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:28.781993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056f68d-2ba1-4562-939f-1daba50c8cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:28.783281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056f68d-2ba1-4562-939f-1daba50c8cbb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.783723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056f68d-2ba1-4562-939f-1daba50c8cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.784400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056f68d-2ba1-4562-939f-1daba50c8cbb None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.785246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056f68d-2ba1-4562-939f-1daba50c8cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:28.785952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056f68d-2ba1-4562-939f-1daba50c8cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:28.788245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056f68d-2ba1-4562-939f-1daba50c8cbb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:28.804663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 360/727] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:28.806112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdb74c-6ae2-4bc0-ae6c-f2ea918b2aac None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.806542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdb74c-6ae2-4bc0-ae6c-f2ea918b2aac None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.806961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdb74c-6ae2-4bc0-ae6c-f2ea918b2aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.813224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 368/728] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:28.814210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b15b4b-6467-4ea1-b341-90336e014700 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:28.821995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:28.830196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-88fdb74c-6ae2-4bc0-ae6c-f2ea918b2aac None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:28.832339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88fdb74c-6ae2-4bc0-ae6c-f2ea918b2aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:28.919490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 361/729] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:28.921144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdb74c-6ae2-4bc0-ae6c-f2ea918b2aac None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:28.935733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b15b4b-6467-4ea1-b341-90336e014700 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:28.961427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:28.974090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:28.974746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:28.975029 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:28.975307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:28.983992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:28.985717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:29.000069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:29.001081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:29.002062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:29.006305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 369/730] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:29.007174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.053647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdb74c-6ae2-4bc0-ae6c-f2ea918b2aac None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.098651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.099961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.100475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.100950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.104653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.115996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:29.117508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe2d3-dc20-44a5-adf4-0d9cc1564b1c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:29.122653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:29.123597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:29.124446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:29.126772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 362/731] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:29.127408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.157547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.158205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.158533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.158817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.170733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:29.176699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:29.177685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:29.178527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 370/732] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:29.179770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.250649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.269906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b729c8e-9c07-4086-867f-a679e7b89e06 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.313218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd34dc-3b50-44e8-afef-5003b942a506 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.314815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.315774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.316253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.316724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.317772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:29.318279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:29.319906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.340110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 363/733] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:29.341411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.353385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.354161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.354341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.354678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.355510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:29.355825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:29.357396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.366547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 371/734] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:29.367206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.405587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.454791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594fd74-f1e4-4af4-89a4-99864c3da340 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.475159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0362aa-60e6-4378-b3d0-9afc66c5d730 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.483544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.492332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299aa8-1756-4f65-9c12-1dbdf2b668c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.492970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299aa8-1756-4f65-9c12-1dbdf2b668c4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.493258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299aa8-1756-4f65-9c12-1dbdf2b668c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.493571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299aa8-1756-4f65-9c12-1dbdf2b668c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.494303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299aa8-1756-4f65-9c12-1dbdf2b668c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:29.494614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299aa8-1756-4f65-9c12-1dbdf2b668c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:29.496107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299aa8-1756-4f65-9c12-1dbdf2b668c4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.504396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 364/735] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:29.505547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6a77-ead1-46d9-8330-9575c2b06aa1 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.505864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6a77-ead1-46d9-8330-9575c2b06aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.506152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6a77-ead1-46d9-8330-9575c2b06aa1 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.507511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 365/736] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:29.508050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6a77-ead1-46d9-8330-9575c2b06aa1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.515826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478ab5b-198b-46ea-938f-0cd73f450ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.516479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ab5b-198b-46ea-938f-0cd73f450ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.516758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ab5b-198b-46ea-938f-0cd73f450ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.517025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ab5b-198b-46ea-938f-0cd73f450ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.581372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478ab5b-198b-46ea-938f-0cd73f450ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:29.582853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478ab5b-198b-46ea-938f-0cd73f450ac2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.608962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6a77-ead1-46d9-8330-9575c2b06aa1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.624881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.643311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e548186-8617-478c-8df9-1cd076b78848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.643953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e548186-8617-478c-8df9-1cd076b78848 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.644238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e548186-8617-478c-8df9-1cd076b78848 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.644517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e548186-8617-478c-8df9-1cd076b78848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.655321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e548186-8617-478c-8df9-1cd076b78848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:29.656798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e548186-8617-478c-8df9-1cd076b78848 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0e548186-8617-478c-8df9-1cd076b78848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:29.670977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:29.671900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:29.672822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:29.672822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:29.672822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:29.672822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:29.672822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 366/737] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:29.673634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ca42-90b6-4211-9c15-b0376181dbd9 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.673963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ca42-90b6-4211-9c15-b0376181dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.674245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ca42-90b6-4211-9c15-b0376181dbd9 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.675484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 367/738] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:29.676177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ca42-90b6-4211-9c15-b0376181dbd9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.691365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 372/739] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 08:19:29.691365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96c7a-11cd-48ca-aa0a-9101ef4c3948 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.691365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96c7a-11cd-48ca-aa0a-9101ef4c3948 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.691705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96c7a-11cd-48ca-aa0a-9101ef4c3948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.704623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.711171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3bf96c7a-11cd-48ca-aa0a-9101ef4c3948 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:29.712371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3bf96c7a-11cd-48ca-aa0a-9101ef4c3948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:29.777942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 373/740] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:29.778686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96c7a-11cd-48ca-aa0a-9101ef4c3948 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.786289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ca42-90b6-4211-9c15-b0376181dbd9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.819407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d302f-bd63-4a1d-ba18-4051b8cd5993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.820052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d302f-bd63-4a1d-ba18-4051b8cd5993 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.820335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d302f-bd63-4a1d-ba18-4051b8cd5993 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.820608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d302f-bd63-4a1d-ba18-4051b8cd5993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.831554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d302f-bd63-4a1d-ba18-4051b8cd5993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:29.833003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d302f-bd63-4a1d-ba18-4051b8cd5993 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ec6d302f-bd63-4a1d-ba18-4051b8cd5993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:29.847433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:29.848367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:29.849297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:29.849297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:29.849297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:29.849297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:29.849297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 368/741] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:29.849857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5b3a-22a3-43d0-a626-c33825f5f7f5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.850141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5b3a-22a3-43d0-a626-c33825f5f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.850448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5b3a-22a3-43d0-a626-c33825f5f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.867775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-919e5b3a-22a3-43d0-a626-c33825f5f7f5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:29.868981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-919e5b3a-22a3-43d0-a626-c33825f5f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:29.882642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.888978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96c7a-11cd-48ca-aa0a-9101ef4c3948 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:29.922129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:29.922753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:29.923036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:29.923310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:29.924001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:29.924301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:29.925722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:29.927947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:29.936831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 369/742] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 08:19:29.937719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5b3a-22a3-43d0-a626-c33825f5f7f5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:29.938087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 374/743] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:29.938766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.045571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5b3a-22a3-43d0-a626-c33825f5f7f5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.055259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9ecd-6d89-466c-a7ad-55732a57693c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.078582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.079220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.079503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.079780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.089108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.090098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.090246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.090438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.090709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.091424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.091742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.092784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:30.107661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:30.108620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:30.109548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:30.109548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:30.109548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:30.109548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:30.109548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 370/744] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:30.109823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.112212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:30.113476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 375/745] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:19:29 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:30.114564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.176457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:30.235075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcc522-7950-499d-b8bf-75064ed9e24c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.253139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b4776-e1f6-41d2-ba61-2237ee9e5210 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.282344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.283267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.283546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.283818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.293308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.294127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.294330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.294966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.295299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.295831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.296288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:30.297068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.298662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:30.306500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:30.307478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 376/746] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:30.309428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.315590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 371/747] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:30.316331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.382073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:30.416804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b25a-95b1-47e6-92f0-d20b7a210bd7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.423607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cfc2d-3492-4e62-91b0-05aec0b06efa None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.430829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:30.453890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.454587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.454864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.455138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.455875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.457611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.459054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.459681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.459965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.460241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.460967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:30.461304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.462661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.481535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 377/748] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:19:30 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:30.481535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.481843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 372/749] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:30.481843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.606913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fab33-e14c-41a7-a2eb-8bf4630d1460 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.618859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24289f-7f4b-450c-8457-c1a41fad9887 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.659021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:30.660204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.660848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.661738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.661738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.662213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:30.662514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.664018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.689321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 378/750] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:30.689321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.695060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.696358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.696858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.697711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.709894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.711360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.723543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:30.726076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:30.731271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 373/751] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:30.732280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.824591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a384014-e85a-4b58-a56f-a787dc7c769f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.840122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df35da-1742-41d3-9336-2f2c97c044d4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:30.875180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.876688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.877119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.877675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.880371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:30.881157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:30.881377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:30.881654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:30.886648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.888317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.893175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:30.894667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:30.903100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:30.904354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:30.905258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 379/752] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:30.911608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:30.920538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:30.921698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:30.922582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:30.922582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:30.922582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:30.922582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:30.929548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 374/753] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:30.930688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:30.969333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.002461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.019446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd96637-f358-4d11-9ebd-a781f39d8ed3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.053860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e832e-69a2-4b99-a3ab-b235fc953841 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.054477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.055105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.055384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.055658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.056461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:31.056836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.058560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.081183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 380/754] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:31.082177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.103463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.105308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.106008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.106561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.107737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:31.108642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.110796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.132848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 375/755] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:31.132848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.210284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0404c9-794c-4b4f-96e9-5551065349a1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.233348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.246021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbe98e-6eec-4867-801b-f83d07de1cd5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.265312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.265312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.265312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.265312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.265811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:31.265811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.267078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.285441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 381/756] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:31.286405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.288644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.289299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.289579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.289852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.295294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.374453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.376000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.415979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc0a5-5f87-408c-abea-d84b71e8bf0f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.460994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.462342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.462833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.463303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.465163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e3ed5e24f863460ab8dea052bed1dac3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:31.465748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.467930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.471023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.482133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 376/757] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:19:31.482133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.483558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 382/758] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/role_assignments?user.id=e3ed5e24f863460ab8dea052bed1dac3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:31.485885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.567375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.610263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d35409-082e-4fe4-b5de-f3ecb5cc4429 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.653474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.655140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.655589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.656024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.673375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.675630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:31.693922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:31.695094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:31.696199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:31.696199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:31.696199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:31.696199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:31.698496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 383/759] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:31.701270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89efe6-4f05-4241-acd6-81e9367fe4a0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.709340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.782638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.783304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.783585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.783858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.798181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.799644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:31.818242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:31.819183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:31.820080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 377/760] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:31.829587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.851417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f43d3-8680-4b36-b7e6-59da350077f4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.888812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.892310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:31.921752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.922490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.922781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.923058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.923823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:31.924075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.925708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:31.940490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889931d-8293-4136-99a1-e3d770581c2f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:31.951224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 384/761] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:31.956812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:31.982082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:31.982716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:31.982996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:31.983272 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:31.984032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:31.984337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:31.985799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:32.007814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 378/762] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:32.015494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:32.101764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006026-ddb2-4dc7-9f49-5bab67e0303c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:32.151693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:32.152343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.152659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.152934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.169095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:32.173592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:32.199437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:32.200405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:32.201334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:32.204487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 385/763] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:32.206331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:32.237415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fdd59-525a-42ce-84e4-22f43187cce9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:32.259032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:32.281481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:32.283029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366510e9-f042-43f6-b28a-64b784d48aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:32.283946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366510e9-f042-43f6-b28a-64b784d48aa3 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.284167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366510e9-f042-43f6-b28a-64b784d48aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.284477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366510e9-f042-43f6-b28a-64b784d48aa3 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/577eab0ae167408086ce9260a4f237e3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.286667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366510e9-f042-43f6-b28a-64b784d48aa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=577eab0ae167408086ce9260a4f237e3, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:32.288467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366510e9-f042-43f6-b28a-64b784d48aa3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:32.303619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 379/764] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:32 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/577eab0ae167408086ce9260a4f237e3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:19:32.304704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52cd5-833c-41c4-a525-f368f58b3edb None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.305060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52cd5-833c-41c4-a525-f368f58b3edb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.305525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52cd5-833c-41c4-a525-f368f58b3edb None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.307394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 380/765] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:32.315141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefab7-50f2-4493-8e0c-17eae353b88d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.319354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefab7-50f2-4493-8e0c-17eae353b88d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.319961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefab7-50f2-4493-8e0c-17eae353b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.364001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-14fefab7-50f2-4493-8e0c-17eae353b88d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:32.365300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-14fefab7-50f2-4493-8e0c-17eae353b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:32.376380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bb496-f96a-402b-9636-e5d4a19741be None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:32.415808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:32.416730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.417182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.417625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.418583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:32.419047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:32.420800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:32.436192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 386/766] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:32.447609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:32.519845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 381/767] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:32.543729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefab7-50f2-4493-8e0c-17eae353b88d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:32.558709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:32.562113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffc4ed-6180-4fa1-92a6-2aa09a8c2c59 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:32.613743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:32.614730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.615262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.615544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.616362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e7576c5e6d64401bba9e8d23ca0c638b) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:32.616645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:32.618297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:32.634582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 387/768] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:32 2022] GET /identity/v3/role_assignments?user.id=e7576c5e6d64401bba9e8d23ca0c638b&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:32.659856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefab7-50f2-4493-8e0c-17eae353b88d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:32.662949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:32.719667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e5b9b-e984-4c6c-96db-ba32d5dad8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:32.720617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5b9b-e984-4c6c-96db-ba32d5dad8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.721076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5b9b-e984-4c6c-96db-ba32d5dad8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.721520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5b9b-e984-4c6c-96db-ba32d5dad8b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.722360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e5b9b-e984-4c6c-96db-ba32d5dad8b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:32.723999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e5b9b-e984-4c6c-96db-ba32d5dad8b3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-859e5b9b-e984-4c6c-96db-ba32d5dad8b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:32.742221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:32.743458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:32.744527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:32.747300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 382/769] 10.222.0.47 () {56 vars in 1129 bytes} [Fri Jul 29 08:19:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:32.753540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:32.812623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c8a5-199e-480a-86f6-cb103031e800 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.813211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c8a5-199e-480a-86f6-cb103031e800 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.813863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c8a5-199e-480a-86f6-cb103031e800 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.816484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 383/770] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:32.823644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77dd0e-a461-4334-bea1-626e58ff4246 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.824029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77dd0e-a461-4334-bea1-626e58ff4246 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.824698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77dd0e-a461-4334-bea1-626e58ff4246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.846191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bf77dd0e-a461-4334-bea1-626e58ff4246 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:32.847539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bf77dd0e-a461-4334-bea1-626e58ff4246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:32.870968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124029-f9f8-4897-99a4-58e01b3d004b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:32.910946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:32.911975 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:32.912426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:32.912887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:32.913737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:32.914355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:32.916041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:32.922051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 388/771] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Jul 29 08:19:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:32.927291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 384/772] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:32.928203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:32.952765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77dd0e-a461-4334-bea1-626e58ff4246 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:32.988282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:33.121793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004df51-88a6-44ed-a021-3d426d715f59 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:33.132435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:33.139733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77dd0e-a461-4334-bea1-626e58ff4246 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:33.194037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:33.195493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:33.196079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:33.197675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:33.198851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:33.200356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:33.202263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:33.203601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:33.204431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:33.206333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:33.206759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] PATH_INFO: `/v3/services/network` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:33.207543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:33.209841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:33.212952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 389/773] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Jul 29 08:19:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:33.219471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:33.220693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:33.221674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:33.222520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:33.225377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 385/774] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:32 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:33.236372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:33.404374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:33.422165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffdd7d-3e62-431d-8479-e7ee7adb2e72 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:33.442421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74533aaf-2689-4e50-9650-c9eb9c4fde61 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:33.466538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:33.467203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:33.467477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:33.467753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:33.468523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] RBAC: Adding query filter params (interface=public, service_id=0af1382f643740c587e01eab38858136, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:33.468832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:33.475994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:33.498449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 390/775] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:19:33 2022] GET /identity/v3/endpoints?service_id=0af1382f643740c587e01eab38858136&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:33.503403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:33.517025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:33.517699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:33.517982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:33.518259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:33.518955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] RBAC: Adding query filter params (name=network) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:33.519259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:33.522478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:33.535151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 386/776] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:33.542563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:33.629699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:33.645426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f0dcb-c781-4c27-b958-6d422e8ab69b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:33.660657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d0b7f-f25e-44ab-8bf5-9840e69489cd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:33.686462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:33.687155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:33.687439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:33.687806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:33.688479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:33.689934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:33.696258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 391/777] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:19:33 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:33.699592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:33.700237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:33.700518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:33.700793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:33.707081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] RBAC: Adding query filter params (type=network) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:33.707081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:33.707081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:33.709659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 387/778] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:33.716142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:33.754376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:33.869670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16687154-b1e0-476d-9321-3afe6852a7bf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:33.910506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f935-7af7-4c6a-9507-1164b01f7aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:33.911580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f935-7af7-4c6a-9507-1164b01f7aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:33.912030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f935-7af7-4c6a-9507-1164b01f7aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:33.912450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f935-7af7-4c6a-9507-1164b01f7aa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:33.913499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305f935-7af7-4c6a-9507-1164b01f7aa6 None admin] RBAC: Adding query filter params (interface=public, service_id=a2a1647522094dcdafa8992104e8df35, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:33.913976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305f935-7af7-4c6a-9507-1164b01f7aa6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:33.915578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305f935-7af7-4c6a-9507-1164b01f7aa6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:33.922950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 392/779] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:19:33 2022] GET /identity/v3/endpoints?service_id=a2a1647522094dcdafa8992104e8df35&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:33.934631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:34.023452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48707d1d-f40c-49a2-a532-17939f57cb7d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:34.024173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48707d1d-f40c-49a2-a532-17939f57cb7d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:34.024525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48707d1d-f40c-49a2-a532-17939f57cb7d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:34.026284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 393/780] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:34.031505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1bbd9-6b54-408c-8771-624016b145f6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:34.031896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1bbd9-6b54-408c-8771-624016b145f6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:34.032273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1bbd9-6b54-408c-8771-624016b145f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:34.042868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:34.056003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701b727-bfa4-4f15-add0-94adebbe555c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:34.085323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d5b1bbd9-6b54-408c-8771-624016b145f6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:34.087805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d5b1bbd9-6b54-408c-8771-624016b145f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:34.112764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:34.113757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:34.114209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:34.114652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:34.115461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:34.117066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:34.126889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 388/781] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:19:33 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:34.191367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 394/782] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:34.227864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:34.366633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a42c-2daf-4ee1-b913-bad0bf655e8e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:34.401377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:34.402026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:34.402305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:34.402663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:34.413657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:34.418706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:34.419824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:34.420872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 389/783] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:34.425907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1bbd9-6b54-408c-8771-624016b145f6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:34.442262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:34.542116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1bbd9-6b54-408c-8771-624016b145f6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:34.581951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:34.582582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:34.582858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:34.583130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:34.583847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:34.584154 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:34.585612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:34.596992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 395/784] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:34.602785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:34.620062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:34.728055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fc8a0-2659-4a13-831a-c70863fa41f7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:34.764189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84db5-a6ce-45a5-af3f-f77ff62f2b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:34.764837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84db5-a6ce-45a5-af3f-f77ff62f2b21 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:34.765116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84db5-a6ce-45a5-af3f-f77ff62f2b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:34.765421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84db5-a6ce-45a5-af3f-f77ff62f2b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:34.775941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf84db5-a6ce-45a5-af3f-f77ff62f2b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:34.777549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf84db5-a6ce-45a5-af3f-f77ff62f2b21 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cbf84db5-a6ce-45a5-af3f-f77ff62f2b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:34.793300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:34.794224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:34.795127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:34.795127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:34.795127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:34.795127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:34.795127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 390/785] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:34.802433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:34.911417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:34.945048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf259-a947-403e-85d6-2c640a35af98 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:34.989235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a266f7-c1c1-46d2-8818-1467469ecb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:34.989810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a266f7-c1c1-46d2-8818-1467469ecb80 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:34.990092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a266f7-c1c1-46d2-8818-1467469ecb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:34.990366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a266f7-c1c1-46d2-8818-1467469ecb80 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:34.991070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a266f7-c1c1-46d2-8818-1467469ecb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:34.991376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a266f7-c1c1-46d2-8818-1467469ecb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:34.992781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a266f7-c1c1-46d2-8818-1467469ecb80 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.006794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1634067-3bbb-4367-b0a9-b922d575e851 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.007118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1634067-3bbb-4367-b0a9-b922d575e851 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.007354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1634067-3bbb-4367-b0a9-b922d575e851 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.011760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 396/787] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:35.012078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 391/787] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:35.016934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1d67-dda6-4234-8a50-07942d505ea7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.017224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1d67-dda6-4234-8a50-07942d505ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.017529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1d67-dda6-4234-8a50-07942d505ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.017833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1634067-3bbb-4367-b0a9-b922d575e851 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.042482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-281a1d67-dda6-4234-8a50-07942d505ea7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:35.043858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-281a1d67-dda6-4234-8a50-07942d505ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:35.095256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:35.112440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 397/788] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:35.113782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e619-134a-4a79-85c0-95d826202afe None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.114076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e619-134a-4a79-85c0-95d826202afe None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.114356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e619-134a-4a79-85c0-95d826202afe None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.115898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 398/789] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:35.121083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70223e3-e525-4978-8b97-82f43aab3ac3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.121457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70223e3-e525-4978-8b97-82f43aab3ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.121739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70223e3-e525-4978-8b97-82f43aab3ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.127438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1634067-3bbb-4367-b0a9-b922d575e851 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.140217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b70223e3-e525-4978-8b97-82f43aab3ac3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:35.141444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b70223e3-e525-4978-8b97-82f43aab3ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:35.162850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.163897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.164518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.164968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.174305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:35.176118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:35.190798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:35.191804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:35.192759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:35.195519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 392/790] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:35.196620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.223539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 399/791] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:35.229908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70223e3-e525-4978-8b97-82f43aab3ac3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.233739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:35.312917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40072852-c633-4563-8ab5-3196b2c61ec1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.338729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:35.348830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.349793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.350336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.350962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.356039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70223e3-e525-4978-8b97-82f43aab3ac3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.361998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:35.367716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:35.368649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:35.369541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:35.372288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 393/792] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:35.373375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.390650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.391283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.391561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.391828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.392732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:35.393016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:35.394613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.412722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 400/793] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:35.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.476910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8f2e-2be1-4593-93b7-c46a859a6fea None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.477670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:35.512261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.513261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.513728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.514159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.516574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b64bb-6584-4fa4-8a4f-e74b992e2048 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.525065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:35.530921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:35.532032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:35.533080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:35.535453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 394/794] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:35.536545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.562763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.563915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.564337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.564779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.565677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:35.566117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:35.568342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.579289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 401/795] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:35.580613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.596067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:35.669556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756ea7-95b6-456c-be42-02a8aa953a6f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.706062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.706731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.707003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.707283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.709020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae8f5-c997-416c-a0a6-d76f79dcb84a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.720464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:35.722115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.728439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:35.739919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:35.740990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:35.742261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:35.742261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:35.742261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:35.742261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:35.742261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 395/796] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:35.742534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.753386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.754221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.754636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.755399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.756266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:35.757013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:35.758838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.769786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 402/797] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:35.771397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.847684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:35.852688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7399-b3cb-48e7-ac99-7d4f59de3c76 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.888175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edd7b7-89c2-43a2-bb00-334579972e33 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:35.899582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.900668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.901092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.901568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.915081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:35.917304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.923983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:35.924850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:35.925198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:35.925593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:35.926446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:35.927079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:35.928445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:35.934190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:35.935239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:35.936331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:35.936331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:35.936331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:35.936331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:35.938211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 396/798] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:35.939659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.944874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 403/799] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:35.945514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:35.991027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.057159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f92d3c-3088-4213-82e9-b758f25627d8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.073734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29160c3-20de-4ae2-84f3-64a9d2dea534 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.093224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.094302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.094696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.095072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.096201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:36.096613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.098444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.111877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 404/800] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:36.112513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.118680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380c619-5931-4e65-9352-f707df6be147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.119338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c619-5931-4e65-9352-f707df6be147 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.119618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c619-5931-4e65-9352-f707df6be147 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.119893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c619-5931-4e65-9352-f707df6be147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.132096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380c619-5931-4e65-9352-f707df6be147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.133583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380c619-5931-4e65-9352-f707df6be147 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2380c619-5931-4e65-9352-f707df6be147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:36.147816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:36.148722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:36.149673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:36.149673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:36.149673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:36.149673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:36.153635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 397/801] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:36.154947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea5be-1434-4f1c-9c01-777bbc076260 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.155225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea5be-1434-4f1c-9c01-777bbc076260 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.155499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea5be-1434-4f1c-9c01-777bbc076260 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.161222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 398/802] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:36.161222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dea5be-1434-4f1c-9c01-777bbc076260 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.163846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.223016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.228121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed9a45-1fae-4a83-860a-3234aa03c29e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.273888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.274634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.275017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.275297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.276042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dea5be-1434-4f1c-9c01-777bbc076260 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.282504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.283966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:36.295385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:36.296318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:36.297207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 405/803] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:36.298683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.315650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4718be1-28ed-4955-b0d7-2bc50bd4d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.316240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4718be1-28ed-4955-b0d7-2bc50bd4d05c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.316518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4718be1-28ed-4955-b0d7-2bc50bd4d05c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.316822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4718be1-28ed-4955-b0d7-2bc50bd4d05c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.324780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4718be1-28ed-4955-b0d7-2bc50bd4d05c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.326265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4718be1-28ed-4955-b0d7-2bc50bd4d05c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f4718be1-28ed-4955-b0d7-2bc50bd4d05c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:36.337460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:36.338407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:36.339337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 399/804] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:36.340704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7ea6-e9bf-40a6-a414-3f3ba2825721 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.340704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7ea6-e9bf-40a6-a414-3f3ba2825721 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.340704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7ea6-e9bf-40a6-a414-3f3ba2825721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.358865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8ace7ea6-e9bf-40a6-a414-3f3ba2825721 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:36.360065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8ace7ea6-e9bf-40a6-a414-3f3ba2825721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:36.408998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5fabc-cec7-4f89-9156-dfcb3faf8720 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.418579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.430392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 400/805] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:36.431119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7ea6-e9bf-40a6-a414-3f3ba2825721 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.455580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.456228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.456485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.456746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.457477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:36.457777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.459190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.472569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 406/806] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:36.473444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.503818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.548245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7ea6-e9bf-40a6-a414-3f3ba2825721 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.581621 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.582178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.582459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.582735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.583484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:36.583806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.585238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.589118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9a8c9-5259-472e-8729-aa77d0133372 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.596917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 401/807] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:36.597730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.625800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.626424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.626706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.626979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.627778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:36.628101 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.629568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.646378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 407/808] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:36.647165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.648457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.696060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d4efb-e69f-498c-bcc5-fbcecf18ac6f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.722278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.730394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d983fd-9cea-4557-b640-e35a322e24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.731128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d983fd-9cea-4557-b640-e35a322e24ed None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.731417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d983fd-9cea-4557-b640-e35a322e24ed None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.731699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d983fd-9cea-4557-b640-e35a322e24ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.732365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d983fd-9cea-4557-b640-e35a322e24ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.733789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d983fd-9cea-4557-b640-e35a322e24ed None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-28d983fd-9cea-4557-b640-e35a322e24ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:36.743339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:36.744414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:36.745267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 402/809] 10.222.0.47 () {56 vars in 1129 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:36.746396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7e5d-9bc1-41a6-994e-410ccc890936 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.746396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7e5d-9bc1-41a6-994e-410ccc890936 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.746396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7e5d-9bc1-41a6-994e-410ccc890936 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.747935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 403/810] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:36.748625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe7e5d-9bc1-41a6-994e-410ccc890936 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.753683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd20e1a-cc93-4eda-b362-a223769f4024 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.788251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.788895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.789172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.789477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.796453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.797930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:36.809235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:36.810472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 408/811] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:36.811437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.855679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe7e5d-9bc1-41a6-994e-410ccc890936 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.871396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:36.888922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.889712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.889995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.890375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e3ed5e24f863460ab8dea052bed1dac3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.892316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=e3ed5e24f863460ab8dea052bed1dac3, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:36.893789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:36.906441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 404/812] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:36 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e3ed5e24f863460ab8dea052bed1dac3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:19:36.907229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:36.908954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585322d-07b3-4947-9b8c-2d6470548b29 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:36.950813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:36.951508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:36.951722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:36.952030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:36.957215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.035939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556153-1549-4318-b45f-ff4265be9327 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.036166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.037486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.079498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9f5ba-9e05-450b-8647-582244138bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.080272 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9f5ba-9e05-450b-8647-582244138bbb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.080484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9f5ba-9e05-450b-8647-582244138bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.080768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9f5ba-9e05-450b-8647-582244138bbb None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.081497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9f5ba-9e05-450b-8647-582244138bbb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:37.081812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9f5ba-9e05-450b-8647-582244138bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.083238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9f5ba-9e05-450b-8647-582244138bbb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.089317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 405/813] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:37.090176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d461807-c4b7-4a1f-b869-3d4b0bc80412 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.090404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d461807-c4b7-4a1f-b869-3d4b0bc80412 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.090695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d461807-c4b7-4a1f-b869-3d4b0bc80412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.110886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2d461807-c4b7-4a1f-b869-3d4b0bc80412 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:37.112722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d461807-c4b7-4a1f-b869-3d4b0bc80412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:37.145002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 409/814] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:19:37.150214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.151654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.189330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 406/815] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:37.189330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d461807-c4b7-4a1f-b869-3d4b0bc80412 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.194643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.283421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62e01-efb4-4c51-9d51-0020bdb81c14 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.305023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d461807-c4b7-4a1f-b869-3d4b0bc80412 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.326647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.327583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.327583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.327813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.328644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:37.328962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.330450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.343936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.344587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.344876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.345154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.345915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:37.346299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.347609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.350421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 410/816] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:37.351675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.357358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 407/817] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:37.357358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.395789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.454024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.461208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb9a32-af58-4ecb-bb1d-a193168ddb1d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.467401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabba6-f921-447b-af5d-d156a435aadb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.493904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.494552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.494827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.495097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.503143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.503801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.504087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.504366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] PATH_INFO: `/v3/services/network` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.504996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.505355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.506469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.506913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:37.516220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:37.517550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:37.518438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 408/818] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:37.519230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:37.527568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:37.528482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:37.529399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:37.529399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:37.529399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:37.529399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:37.529399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 411/819] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:37.529670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.625701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.630376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4915-d28c-4d7a-872e-12e4346dd001 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.636034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364b427-2b72-4370-8ee4-15d14e5061e2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.667992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.668993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.669512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.669954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.670583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.671185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.671464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.671789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.672551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.674018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.681907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.683517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.697727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 412/820] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:19:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:37.698538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:37.700293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:37.701540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:37.702455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:37.702455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:37.702455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:37.702455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:37.706465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 409/821] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:37.707529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.711575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.827665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb352e-1cee-4bbd-bfde-75495e785e99 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.865451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58fc6-d834-4bbb-b3ef-1a134cabb31a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:37.866947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.867586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.867871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.868146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.868853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:37.869146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.871330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.885863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 410/822] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:37.887116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:37.901034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:37.915406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:37.916307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:37.916626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:37.917000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:37.918239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] RBAC: Adding query filter params (name=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:37.918239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:37.919960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:37.925733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 413/823] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:37.926356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.007576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:38.015902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96c5f4-1ebb-4d99-841c-ce35919377ef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.043769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11907bd8-e96c-44b7-afb5-0d5eb47cb47f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.051773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.052401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.052680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.052951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.053692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:38.053994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.055358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.067748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 411/824] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:38.068603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.079140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.079938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.080320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.080691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.088020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.090118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:38.102140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:38.103109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:38.104282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:38.108855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 414/825] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:38.109806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.141712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:38.175023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84f1b-5ae4-4c14-ac67-8a087ceccaee None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.211021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.212490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.212947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.213426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.214278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] RBAC: Adding query filter params (type=network) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:38.214914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd3507-53ba-484e-aa68-04ff6f727c2d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.215378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.217089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.228599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 412/826] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:38.229727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.253674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:38.266748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.267523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.267995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.268562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.278077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.280186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:38.295530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:38.296615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:38.297736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:38.299427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 415/827] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:38.300900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.352647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269106f-71c1-4da4-8f25-9afdf9c92d70 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.387618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.388335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.388684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.389070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.389912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:38.390284 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.391768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.393487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:38.405509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 413/828] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:38.407374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.412978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5684bc9-45f5-42af-a7a5-231afdd81d8e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.448270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.449268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.449770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.450259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.451163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.452773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.481669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 416/829] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:19:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:38.483033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.521485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef943d-3eb6-4429-a4c4-13d54e86b583 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.557906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:38.570546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.571162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.571948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.572227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.574069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:38.574733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.576282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.590598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 414/830] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:38.595963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:38.660446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:38.701930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944550d-1949-4ddf-85d8-99c399926bb4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.746277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c5a0-926d-4898-994f-d28c33a1b8bc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:38.761154 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0010b82-c902-415e-93d1-26097b40bea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.763062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0010b82-c902-415e-93d1-26097b40bea7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.763346 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0010b82-c902-415e-93d1-26097b40bea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.763614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0010b82-c902-415e-93d1-26097b40bea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.764424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0010b82-c902-415e-93d1-26097b40bea7 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=577eab0ae167408086ce9260a4f237e3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:38.764721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0010b82-c902-415e-93d1-26097b40bea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.766194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0010b82-c902-415e-93d1-26097b40bea7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.773389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 417/831] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:38 2022] GET /identity/v3/role_assignments?user.id=577eab0ae167408086ce9260a4f237e3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:38.788283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5563ca-32fd-4400-ad28-42aba304b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:38.789001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5563ca-32fd-4400-ad28-42aba304b5aa None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:38.789313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5563ca-32fd-4400-ad28-42aba304b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:38.789599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5563ca-32fd-4400-ad28-42aba304b5aa None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e7576c5e6d64401bba9e8d23ca0c638b/roles/69363a3115984b76a7def98b3e959add` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:38.807908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5563ca-32fd-4400-ad28-42aba304b5aa None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=e7576c5e6d64401bba9e8d23ca0c638b, role_id=69363a3115984b76a7def98b3e959add)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:38.809484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5563ca-32fd-4400-ad28-42aba304b5aa None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:38.833684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 415/832] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:38 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e7576c5e6d64401bba9e8d23ca0c638b/roles/69363a3115984b76a7def98b3e959add => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:19:38.999909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4d754-a27f-4565-8647-85cc50cad9b4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.000417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4d754-a27f-4565-8647-85cc50cad9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.000697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4d754-a27f-4565-8647-85cc50cad9b4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.002338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 418/833] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:39.007962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dea7-a617-49a4-9512-283ca4508fd1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.008263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dea7-a617-49a4-9512-283ca4508fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.008558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dea7-a617-49a4-9512-283ca4508fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.030153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-97e0dea7-a617-49a4-9512-283ca4508fd1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:39.031375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-97e0dea7-a617-49a4-9512-283ca4508fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:39.100613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 416/834] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:39.124322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4d754-a27f-4565-8647-85cc50cad9b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:39.229114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4d754-a27f-4565-8647-85cc50cad9b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:39.231116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:39.276458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:39.277133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.277500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.277780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.289271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:39.294363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:39.295284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:19:39.296135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:39.300903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 419/835] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:39.302556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0dea7-a617-49a4-9512-283ca4508fd1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:39.336755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:39.417317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0dea7-a617-49a4-9512-283ca4508fd1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:39.452872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:39.453524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.453802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.454073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.454796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:39.455098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:39.456467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:39.465688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 417/836] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:39.471160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:39.575672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958145d-d55b-4eb6-a6d8-0c89a5a4e171 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:39.611104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:39.611771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.612055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.612332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.625048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:39.626556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:39.641690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:39.643706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:39.645847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:39.645847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:39.645847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:39.645847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:39.649330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 420/837] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:39.654392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:39.751403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:39.760247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637aeae-21b2-4444-aa12-69d742f25cf1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:39.794206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbdefe-155f-4984-b97d-4531355399de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:39.794830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbdefe-155f-4984-b97d-4531355399de None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.795110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbdefe-155f-4984-b97d-4531355399de None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.795384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbdefe-155f-4984-b97d-4531355399de None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.796078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbdefe-155f-4984-b97d-4531355399de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:39.796381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbdefe-155f-4984-b97d-4531355399de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:39.797835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbdefe-155f-4984-b97d-4531355399de None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:39.810017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 418/838] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:39.815580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:39.832579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:39.837979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05916-82bb-4aaa-9bfb-33dd24567e71 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.838271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05916-82bb-4aaa-9bfb-33dd24567e71 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.838549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05916-82bb-4aaa-9bfb-33dd24567e71 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.840787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 419/839] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:19:39.845688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e8bd2-d69a-40cb-a44c-8df991cf1e7c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.845963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e8bd2-d69a-40cb-a44c-8df991cf1e7c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.846240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e8bd2-d69a-40cb-a44c-8df991cf1e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.873017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-533e8bd2-d69a-40cb-a44c-8df991cf1e7c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:39.874478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-533e8bd2-d69a-40cb-a44c-8df991cf1e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:39.938132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73950032-80f6-4335-98dd-37dd565e1659 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:39.965541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 420/840] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:39.982249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:39.982908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:39.983185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:39.983459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:39.990320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e8bd2-d69a-40cb-a44c-8df991cf1e7c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:39.991670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:39.994553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:40.009795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:40.010789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:40.011791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 421/841] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:19:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:40.019584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:40.097259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:40.117495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e8bd2-d69a-40cb-a44c-8df991cf1e7c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:40.128335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:40.156502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:40.157607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.158096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.158641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.159237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ed549-4c16-48b7-8acc-c0184457bf3c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:40.159712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:40.161502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:40.171408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:40.172415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:40.173260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:40.176225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 421/842] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:40.185422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:40.194641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:40.195266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.195543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.195816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.196693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:40.197449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:40.199395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.221891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 422/843] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Jul 29 08:19:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:40.227895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:40.319385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b097ce1-c183-4a64-a30e-c71450ce46dd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:40.340139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc775ef3-0da0-4086-b9dd-de96ccfdb258 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:40.364576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:40.366134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.366591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.367282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.368376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:40.368860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:40.371099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.372620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:40.378432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:40.378695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 422/844] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:40.383669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.384323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.384961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.385674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:40.404542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:40.463261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:40.465463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.519898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5edfe8-178f-4a20-985e-64096e58c7f9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:40.571681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:40.572601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.573023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.573467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.574324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:40.574771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:40.575107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 423/845] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:19:40.576528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.585337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:40.588535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 423/846] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:40.622411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:40.700721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e9752-4a52-4358-8d0a-80fea24d2d73 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:40.742484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e2d6a-fea4-4e19-a80a-f0acb0bb0eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:40.743152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e2d6a-fea4-4e19-a80a-f0acb0bb0eda None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.743428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e2d6a-fea4-4e19-a80a-f0acb0bb0eda None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.743697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e2d6a-fea4-4e19-a80a-f0acb0bb0eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.756308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e2d6a-fea4-4e19-a80a-f0acb0bb0eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:40.757859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e2d6a-fea4-4e19-a80a-f0acb0bb0eda None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c61e2d6a-fea4-4e19-a80a-f0acb0bb0eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:40.774166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:40.775110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:40.776242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:40.776242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:40.776242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:40.776242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:40.776242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 424/847] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:40.782772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:40.862854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:40.888218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b206a-a2f3-4497-96fa-85e4d045b727 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:40.922802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:40.923422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.923710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.923984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.924677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:40.924982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:40.926392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:40.934857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ac98-729e-4df3-8635-f8062ceae399 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.935160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ac98-729e-4df3-8635-f8062ceae399 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.935405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ac98-729e-4df3-8635-f8062ceae399 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.937023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 425/848] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:40.941396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 424/849] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:40.942378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3c81-776b-44e4-833c-c1f729a9f143 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:40.942631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3c81-776b-44e4-833c-c1f729a9f143 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:40.942906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3c81-776b-44e4-833c-c1f729a9f143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:40.947856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:40.961806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b13b3c81-776b-44e4-833c-c1f729a9f143 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:40.962997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b13b3c81-776b-44e4-833c-c1f729a9f143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:41.037650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 426/850] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:41.039257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673856c-03c0-4321-bf76-3a27edd76ec9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.039550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673856c-03c0-4321-bf76-3a27edd76ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.039828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673856c-03c0-4321-bf76-3a27edd76ec9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.045769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 427/851] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:41.047058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fba73-6f7e-486e-89d9-47ec5791cd43 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.047350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fba73-6f7e-486e-89d9-47ec5791cd43 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.047627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fba73-6f7e-486e-89d9-47ec5791cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.064257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b120972-2811-4b19-819e-ccfd7f1af578 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.068336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-505fba73-6f7e-486e-89d9-47ec5791cd43 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:41.069577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-505fba73-6f7e-486e-89d9-47ec5791cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:41.080763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.100427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.101088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.101473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.101682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.103871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.110381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.112518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:41.124462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:41.125414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:41.126339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:41.130491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 425/852] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:41.131253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.141421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 428/853] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:41.146456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fba73-6f7e-486e-89d9-47ec5791cd43 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.236266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb9eb-d481-4a15-94e6-64e5fbd634d0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.273786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fba73-6f7e-486e-89d9-47ec5791cd43 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.277063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.277816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.278101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.278376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.289413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:41.294838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:41.295783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:41.296630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 426/854] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:41.297814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.315378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.316192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.316845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.316845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.317694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:41.318001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.319481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.331320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 429/855] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:41.332152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.340673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.364132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.412242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f53b8-c6a2-43da-a76a-5569444c4be9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.444595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7765c-55b8-40fa-a04e-6aba9c63af51 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.449069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.449763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.450105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.450399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.451033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.452419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:41.462372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:41.463281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:41.464116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 427/856] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:41.465432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.483812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.484444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.484715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.484994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.485744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:41.486050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.487445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.495637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 430/857] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:41.496471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.561183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.576524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da9075-6c41-4aec-9a07-08c07edf1675 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.594586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.600334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441a85-e1ee-43c3-9c82-a971259dd60e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.613793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.614423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.614709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.614992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.615795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e3ed5e24f863460ab8dea052bed1dac3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:41.616110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.617795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.633327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 428/858] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/role_assignments?user.id=e3ed5e24f863460ab8dea052bed1dac3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:41.633327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.646498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.647255 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.647589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.648021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.648855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:41.649193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.651009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.661480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 431/859] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:41.664716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.760076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cb4ca-210e-4de7-87d5-02d7636028c7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.798740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.799417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.799829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.800319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.806544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf31f8-a877-47a5-ae7c-a0251072eee5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.813933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.815420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:41.831487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:41.832598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:41.833613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:41.833613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:41.833613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:41.833613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:41.837523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 429/860] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:41.838364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:41.845701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.852243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.852899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.854488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.854488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.854860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:41.855164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:41.856606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:41.862728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 432/861] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:41.879224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:41.958667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf3c8-2d9b-45ea-8313-9cfc5bb14c02 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:41.996328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:41.996959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:41.997243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:41.997548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:41.998257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:41.998561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:42.000078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:42.013255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 430/862] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:42.018893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:42.126958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f601be3-1d7c-4491-bc0d-a96afcb1561a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:42.162665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:42.164288 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:42.164767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:42.165366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:42.173812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:42.175555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:42.187737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:42.188724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:42.189700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:42.192294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 433/863] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:19:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:42.198312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:42.306351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:42.313148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c835-e6a9-4deb-b421-3da4732cb57d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:42.347866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8168cd-1a50-4e77-9ea6-ac1b6d76edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:42.348487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8168cd-1a50-4e77-9ea6-ac1b6d76edba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:42.348764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8168cd-1a50-4e77-9ea6-ac1b6d76edba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:42.349040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8168cd-1a50-4e77-9ea6-ac1b6d76edba None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:42.349883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8168cd-1a50-4e77-9ea6-ac1b6d76edba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:42.350191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8168cd-1a50-4e77-9ea6-ac1b6d76edba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:42.351695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8168cd-1a50-4e77-9ea6-ac1b6d76edba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:42.371706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 431/864] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Jul 29 08:19:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:42.377265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:42.442517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:42.490358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3d44-be5a-48e2-96b9-0b1f07e0cf64 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:42.524911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:42.525816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:42.526263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:42.526680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:42.595837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:42.597600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:42.652252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:42.674666 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d2296-4f8c-4338-a128-ee9b3aa17664 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:42.675291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d2296-4f8c-4338-a128-ee9b3aa17664 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:42.675760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d2296-4f8c-4338-a128-ee9b3aa17664 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:42.677572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 432/865] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:19:42.683109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb75dc6-3e27-4366-84bb-bb81593aca4d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:42.683731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb75dc6-3e27-4366-84bb-bb81593aca4d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:42.684218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb75dc6-3e27-4366-84bb-bb81593aca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:42.699496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 434/866] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:19:42.703682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bbb75dc6-3e27-4366-84bb-bb81593aca4d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:42.705100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bbb75dc6-3e27-4366-84bb-bb81593aca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:42.705207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:42.788413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 433/867] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:42.809425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb75dc6-3e27-4366-84bb-bb81593aca4d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:42.812126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d51ff-eb99-4722-b2aa-f17ed28273a9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:42.857541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:42.858519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:42.859117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:42.859585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:42.872856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:42.875243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:42.893942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:42.895038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:42.896125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:42.896125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:42.896125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:42.896125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:42.902740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 435/868] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:42.903828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:42.904046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:42.913469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:42.926720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb75dc6-3e27-4366-84bb-bb81593aca4d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:42.968170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:42.969093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:42.969679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:42.970146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:42.970979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:42.972758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:42.997600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 434/869] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:19:42 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:19:43.009923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b024-70c9-4f99-8cc0-dcff73245e0f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:43.057927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:43.058505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.058784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.059055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.059815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:43.060122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:43.061566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:43.075669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 436/870] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:43.081418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:43.194129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aa6ab-6a2e-4a88-bc38-417911e4dbc4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:43.230544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:43.231614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.232142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.232612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.240073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:43.241787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:43.264466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:43.265399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:43.266294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:43.268765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 435/871] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:43.274502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:43.339179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:43.379096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8144d-5def-4137-86a3-5a196afea579 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:43.413216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08306-8aed-45b4-90b1-837eb914e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:43.413864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08306-8aed-45b4-90b1-837eb914e482 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.414142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08306-8aed-45b4-90b1-837eb914e482 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.414414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08306-8aed-45b4-90b1-837eb914e482 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.415164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd08306-8aed-45b4-90b1-837eb914e482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:43.415467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd08306-8aed-45b4-90b1-837eb914e482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:43.416910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd08306-8aed-45b4-90b1-837eb914e482 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:43.433435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 437/872] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:43.435466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:43.438469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:43.540232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267363a-370e-43e8-ba55-1785964d76a8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:43.575338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77504e-8fe8-4740-aaee-640f7f89b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:43.575983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77504e-8fe8-4740-aaee-640f7f89b52e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.576238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77504e-8fe8-4740-aaee-640f7f89b52e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.576518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77504e-8fe8-4740-aaee-640f7f89b52e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.577328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77504e-8fe8-4740-aaee-640f7f89b52e None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e7576c5e6d64401bba9e8d23ca0c638b) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:43.577643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77504e-8fe8-4740-aaee-640f7f89b52e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:43.579076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77504e-8fe8-4740-aaee-640f7f89b52e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:43.585524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 436/873] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:43 2022] GET /identity/v3/role_assignments?user.id=e7576c5e6d64401bba9e8d23ca0c638b&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:43.752111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa0e8f-5aab-4222-ad7b-2c9960935171 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.752613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa0e8f-5aab-4222-ad7b-2c9960935171 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.753030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa0e8f-5aab-4222-ad7b-2c9960935171 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.754929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 438/874] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:43.760034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a3907-2107-49c9-9e29-9150db883538 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.760320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a3907-2107-49c9-9e29-9150db883538 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.760597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a3907-2107-49c9-9e29-9150db883538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.780407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fd7a3907-2107-49c9-9e29-9150db883538 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:43.781651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fd7a3907-2107-49c9-9e29-9150db883538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:43.846177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:43.854247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 437/875] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:43.875495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa0e8f-5aab-4222-ad7b-2c9960935171 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:43.929664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad9b9-9a51-463f-a1da-ecdbf9279f9f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.929955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad9b9-9a51-463f-a1da-ecdbf9279f9f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.930237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad9b9-9a51-463f-a1da-ecdbf9279f9f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.931856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 438/876] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:19:43.936726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b2793-aed7-4579-87e9-0c4295e6d47a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:43.937012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b2793-aed7-4579-87e9-0c4295e6d47a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:43.937304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b2793-aed7-4579-87e9-0c4295e6d47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:43.956950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-eb6b2793-aed7-4579-87e9-0c4295e6d47a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:43.958196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-eb6b2793-aed7-4579-87e9-0c4295e6d47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:43.992529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa0e8f-5aab-4222-ad7b-2c9960935171 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:44.019889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:44.032926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:44.033720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:44.034007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:44.034289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:44.034927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:44.036691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:44.047222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:44.048241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:44.049066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:44.049850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 439/878] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:44.053506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 439/878] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:44.054823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b2793-aed7-4579-87e9-0c4295e6d47a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:44.070345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:44.182385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b2793-aed7-4579-87e9-0c4295e6d47a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:44.189433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799baefd-cc84-48dc-8ecd-173f3493c464 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:44.217908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:44.225998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff094d-524f-4510-8d38-3cc9f4601f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:44.226812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff094d-524f-4510-8d38-3cc9f4601f66 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:44.227261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff094d-524f-4510-8d38-3cc9f4601f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:44.227609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff094d-524f-4510-8d38-3cc9f4601f66 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:44.228481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff094d-524f-4510-8d38-3cc9f4601f66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:44.230110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff094d-524f-4510-8d38-3cc9f4601f66 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:44.230491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:44.231331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:44.231802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:44.232249 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:44.233110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:44.233611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:44.236033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:44.248405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 440/879] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:44.250680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:44.259320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 440/880] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:19:44 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:19:44.376317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143af3-bc75-4bc3-ae0d-468c145d7bf7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:44.429962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62a54-ea57-42d5-9f78-fc3263cbee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:44.430611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62a54-ea57-42d5-9f78-fc3263cbee86 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:44.431170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62a54-ea57-42d5-9f78-fc3263cbee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:44.431451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62a54-ea57-42d5-9f78-fc3263cbee86 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:44.432137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62a54-ea57-42d5-9f78-fc3263cbee86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:44.432449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62a54-ea57-42d5-9f78-fc3263cbee86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:44.433932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62a54-ea57-42d5-9f78-fc3263cbee86 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:44.439638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 441/881] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:45.146777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259418a-1775-4882-9792-ad5688430330 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.147350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259418a-1775-4882-9792-ad5688430330 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.147350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259418a-1775-4882-9792-ad5688430330 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.148904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 441/882] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:45.154478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f82ee-ec21-4863-a028-6b5c6130b3a5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.154887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f82ee-ec21-4863-a028-6b5c6130b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.155073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f82ee-ec21-4863-a028-6b5c6130b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.173075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-333f82ee-ec21-4863-a028-6b5c6130b3a5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:45.174311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-333f82ee-ec21-4863-a028-6b5c6130b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:45.222590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:45.244187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 442/883] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:45.271256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259418a-1775-4882-9792-ad5688430330 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:45.327238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:45.388482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259418a-1775-4882-9792-ad5688430330 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:45.425097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:45.425699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.425983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.426257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.426888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:45.428285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:45.437514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:45.438492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:45.439329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 442/884] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:45.446569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f82ee-ec21-4863-a028-6b5c6130b3a5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:45.545965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f82ee-ec21-4863-a028-6b5c6130b3a5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:45.583927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91f20a-8e2d-4994-80b6-b3b5872dfeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:45.584570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f20a-8e2d-4994-80b6-b3b5872dfeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.584851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f20a-8e2d-4994-80b6-b3b5872dfeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.585130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f20a-8e2d-4994-80b6-b3b5872dfeb5 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.585860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91f20a-8e2d-4994-80b6-b3b5872dfeb5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:45.586168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91f20a-8e2d-4994-80b6-b3b5872dfeb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:45.587656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91f20a-8e2d-4994-80b6-b3b5872dfeb5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:45.593668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 443/885] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:45.599315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:45.683779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e7ea-289c-4286-8723-5292166aa4cc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.683978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e7ea-289c-4286-8723-5292166aa4cc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.684250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e7ea-289c-4286-8723-5292166aa4cc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.685914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 444/886] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:45.691321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3674d-ff57-490b-9556-bed6c8c5b6a5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.691607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3674d-ff57-490b-9556-bed6c8c5b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.691882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3674d-ff57-490b-9556-bed6c8c5b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.707443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c06da-2f0d-4d88-a679-ea45a1c2d0be None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:45.709977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e9f3674d-ff57-490b-9556-bed6c8c5b6a5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:45.711150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e9f3674d-ff57-490b-9556-bed6c8c5b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:45.724086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:45.746837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:45.747459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.747748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.748007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.748752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:45.749060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:45.750458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:45.755905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 443/887] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:45.763240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:45.768061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:45.805398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 445/888] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:45.820522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3674d-ff57-490b-9556-bed6c8c5b6a5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:45.886479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372ae7-29b5-4d2a-b2e7-5835c061a356 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:45.930031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:45.931004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.931292 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.931568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.932753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] RBAC: Adding query filter params (interface=public, service_id=7b1ba40a06ec43bfbd066d3a6bfabed3, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:45.933069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:45.935162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:45.938950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3674d-ff57-490b-9556-bed6c8c5b6a5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:45.947221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 444/889] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:19:45 2022] GET /identity/v3/endpoints?service_id=7b1ba40a06ec43bfbd066d3a6bfabed3&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:45.948149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:45.983203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:45.983867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:45.984148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:45.984426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:45.998543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:45.999670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:46.007439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:46.008433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:46.009303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 446/890] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Jul 29 08:19:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:46.016558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.065466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:46.072575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f471-93e4-47a5-8bb7-ccf3a7a0ca39 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.109003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.110030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.110533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.110998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.111842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.113508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.120506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 445/891] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:19:45 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:19:46.154591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc61f-1fc5-4caf-808e-30f245dc5fc9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.193238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02c02-ffa8-4afd-a0dc-a85d862b9b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.193829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02c02-ffa8-4afd-a0dc-a85d862b9b33 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.194113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02c02-ffa8-4afd-a0dc-a85d862b9b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.194395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02c02-ffa8-4afd-a0dc-a85d862b9b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.195137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e02c02-ffa8-4afd-a0dc-a85d862b9b33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:46.195449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e02c02-ffa8-4afd-a0dc-a85d862b9b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.196864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e02c02-ffa8-4afd-a0dc-a85d862b9b33 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.206909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 447/892] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:46.212656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.335516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bbd3a-2533-4589-a099-c315cbebb0dc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.337707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:46.344188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd852e-590c-4cd2-8db7-66893193b25a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.344539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd852e-590c-4cd2-8db7-66893193b25a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.344820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd852e-590c-4cd2-8db7-66893193b25a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.346464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 448/893] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:46.355405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfca880-45f5-467d-b547-4053b54765b2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.355986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfca880-45f5-467d-b547-4053b54765b2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.356470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfca880-45f5-467d-b547-4053b54765b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.375014 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0bfca880-45f5-467d-b547-4053b54765b2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:46.376555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0bfca880-45f5-467d-b547-4053b54765b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:46.380355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.381033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.381339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.381725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.394424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.396411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:46.412594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:46.413559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:46.414484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:46.414484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:46.414484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:46.414484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:46.416974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 446/894] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:46.422776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.451293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 449/895] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:46.473759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfca880-45f5-467d-b547-4053b54765b2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.502761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:46.528627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386465-fa7c-4c44-9954-fda1c228ea04 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.564233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f618a15-8716-4dc3-9abd-3c4459e1dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.564888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618a15-8716-4dc3-9abd-3c4459e1dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.565171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618a15-8716-4dc3-9abd-3c4459e1dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.565475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618a15-8716-4dc3-9abd-3c4459e1dee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.566167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f618a15-8716-4dc3-9abd-3c4459e1dee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:46.566472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f618a15-8716-4dc3-9abd-3c4459e1dee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.567865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f618a15-8716-4dc3-9abd-3c4459e1dee7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.579506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfca880-45f5-467d-b547-4053b54765b2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.585215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 447/896] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:46.585215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31dce-c674-4ee6-b126-77f0e08824ba None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.585215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31dce-c674-4ee6-b126-77f0e08824ba None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.585215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31dce-c674-4ee6-b126-77f0e08824ba None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.585215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 448/897] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:46.585935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31dce-c674-4ee6-b126-77f0e08824ba None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.604510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:46.622806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d2e44-aaa6-4515-a9c7-85f4fcbd2dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.623551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2e44-aaa6-4515-a9c7-85f4fcbd2dfe None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.623834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2e44-aaa6-4515-a9c7-85f4fcbd2dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.624110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2e44-aaa6-4515-a9c7-85f4fcbd2dfe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.624735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d2e44-aaa6-4515-a9c7-85f4fcbd2dfe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.626133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d2e44-aaa6-4515-a9c7-85f4fcbd2dfe None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c21d2e44-aaa6-4515-a9c7-85f4fcbd2dfe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:46.635108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:46.636069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:46.636984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 450/898] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:46.637874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c9be7-8b64-42dc-8b01-f6f06bcf7c0f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.637874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c9be7-8b64-42dc-8b01-f6f06bcf7c0f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.637995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c9be7-8b64-42dc-8b01-f6f06bcf7c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.655979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-078c9be7-8b64-42dc-8b01-f6f06bcf7c0f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:46.657266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-078c9be7-8b64-42dc-8b01-f6f06bcf7c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:46.705995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31dce-c674-4ee6-b126-77f0e08824ba None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.729873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 451/899] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:46.730584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c9be7-8b64-42dc-8b01-f6f06bcf7c0f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.751973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:46.756277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.756938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.757215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.757544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.764785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.766275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:46.777890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:46.778894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:46.779864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 449/900] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:46.781923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.840945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c9be7-8b64-42dc-8b01-f6f06bcf7c0f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.859589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:46.881197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.881854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.882140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.882691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.883105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:46.883411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.884791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.885533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206848e0-862c-4579-8b68-3233bd4bb92b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:46.894061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 452/901] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:46.894061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:46.924370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:46.924924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:46.925208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:46.925514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:46.926199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:46.927647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:46.944228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 450/902] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:19:46 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:46.944887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:47.027718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:47.048293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec74a0f-9078-49a8-93d7-2e27b51b2480 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:47.100054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:47.101042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:47.101465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:47.101835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:47.102820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:47.103499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:47.103614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b4543-6890-4937-9ed8-459246d0078e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:47.104982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:47.126163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 453/903] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:47.133618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:47.149166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:47.156185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:47.156869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:47.157311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:47.158017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:47.158678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:47.159132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:47.160894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:47.166604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 451/904] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:47.173301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:47.263620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986eae2-7eca-414a-b58b-ed370d546992 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:47.303849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:47.304403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:47.304688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:47.304967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:47.313428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf40ed-1dbc-4c17-aabd-eae4297bb830 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:47.314901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:47.362103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:47.362994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:47.364023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:47.364454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:47.365683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] RBAC: Adding query filter params (interface=public, service_id=2847680a9e3442dc9cee28869f1aebf2, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:47.366385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:47.368692 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:47.378959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 452/905] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:19:47 2022] GET /identity/v3/endpoints?service_id=2847680a9e3442dc9cee28869f1aebf2&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:47.385329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:47.385329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:47.386573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:47.466377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:47.501047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 454/906] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:47 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:19:47.508531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:47.525035 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c05cb3-1dc9-4923-ad81-294a5526dd28 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:47.552965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:47.567554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:47.568188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:47.568381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:47.568660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:47.569357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:47.570761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:47.581396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 453/907] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:19:47 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:19:47.637260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a395-e65a-45fb-b361-71d53e49677c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:47.680971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:47.682095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:47.682574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:47.683119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:47.695327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:47.697202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:47.714678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:47.715641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:47.716575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:47.716575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:47.716575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:47.716575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:47.719025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 455/908] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:47.725219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:47.833241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6f09-ec02-4601-8d76-068b8015a04e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:47.856718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:47.869017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:47.870157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:47.870438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:47.870740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:47.871444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:47.871750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:47.873143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:47.885989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 454/909] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:47.891727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:47.987686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:47.998342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168fd5-aea2-43b5-9141-c1649285f181 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:48.034929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d12ba8-3d33-4f18-9ac3-4128704b7fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:48.035963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d12ba8-3d33-4f18-9ac3-4128704b7fda None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.036438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d12ba8-3d33-4f18-9ac3-4128704b7fda None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.036904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d12ba8-3d33-4f18-9ac3-4128704b7fda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.044418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d12ba8-3d33-4f18-9ac3-4128704b7fda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:48.046240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d12ba8-3d33-4f18-9ac3-4128704b7fda None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-91d12ba8-3d33-4f18-9ac3-4128704b7fda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:48.058379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:48.059287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:48.060188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:48.062807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 456/910] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:48.070428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:48.177925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045823c-3abc-41b7-bdb0-b104f11b5e9d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:48.200488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e4109-e2c6-4d41-b6f6-cc1564e8181c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.201111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e4109-e2c6-4d41-b6f6-cc1564e8181c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.201813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e4109-e2c6-4d41-b6f6-cc1564e8181c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.203371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 457/911] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:48.208376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7fe6-6213-44d8-8f2a-c331f38be76e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.208664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7fe6-6213-44d8-8f2a-c331f38be76e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.208945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7fe6-6213-44d8-8f2a-c331f38be76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.213379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:48.214013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.214722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.215002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.215761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:48.216080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:48.217685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:48.233334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 455/912] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:48.236941 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:48.238456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-079d7fe6-6213-44d8-8f2a-c331f38be76e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:48.239875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-079d7fe6-6213-44d8-8f2a-c331f38be76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:48.288437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:48.333432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 458/913] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:48.356023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd663a0-2429-4dd3-a527-7115b8c6540e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:48.358192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7fe6-6213-44d8-8f2a-c331f38be76e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:48.402241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:48.403330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.403679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.404018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.405174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] RBAC: Adding query filter params (role.id=ed22fd6ead7c4837a429f5150feb8fe3, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e7576c5e6d64401bba9e8d23ca0c638b) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:48.405578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:48.407359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:48.417503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 456/914] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:48 2022] GET /identity/v3/role_assignments?user.id=e7576c5e6d64401bba9e8d23ca0c638b&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=ed22fd6ead7c4837a429f5150feb8fe3 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:48.454371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:48.477435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7fe6-6213-44d8-8f2a-c331f38be76e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:48.518901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:48.519920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.520377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.520823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.521671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:48.523370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:48.533760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:48.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 08:19:48.535716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:48.538590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 459/915] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:48.546450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:48.652382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57871a35-01cf-4602-b663-d69c0aac0958 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:48.660140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:48.689610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:48.690243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.690523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.690794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.691470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:48.691773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:48.693213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:48.698688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 457/916] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:48.704740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:48.821198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd49bf9-9704-45e1-a743-ed7e11817604 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:48.860157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b231ea-ee87-4bf8-b83c-3d2154e5ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:48.860792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b231ea-ee87-4bf8-b83c-3d2154e5ae89 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:48.861078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b231ea-ee87-4bf8-b83c-3d2154e5ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:48.861383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b231ea-ee87-4bf8-b83c-3d2154e5ae89 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:48.862070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b231ea-ee87-4bf8-b83c-3d2154e5ae89 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:48.862379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b231ea-ee87-4bf8-b83c-3d2154e5ae89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:48.863770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b231ea-ee87-4bf8-b83c-3d2154e5ae89 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:48.869163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 460/917] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Jul 29 08:19:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:48.874953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:48.978210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc51c-789c-4eb4-961a-cf5a3bdf35ad None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:49.015776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47e037-da25-48e9-a12e-16e2595d1d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:49.016406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e037-da25-48e9-a12e-16e2595d1d1b None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.016684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e037-da25-48e9-a12e-16e2595d1d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.016954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e037-da25-48e9-a12e-16e2595d1d1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.017714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47e037-da25-48e9-a12e-16e2595d1d1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:49.019104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47e037-da25-48e9-a12e-16e2595d1d1b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:49.041607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 458/918] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:19:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:49.059114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6270ca-ba54-432e-a6fb-b23386ce9cab None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.059453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6270ca-ba54-432e-a6fb-b23386ce9cab None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.059689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6270ca-ba54-432e-a6fb-b23386ce9cab None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.061469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 461/919] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:49.067330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b6cb8-34ff-468f-8a33-94cf7ecf2523 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.067661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b6cb8-34ff-468f-8a33-94cf7ecf2523 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.067887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b6cb8-34ff-468f-8a33-94cf7ecf2523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.087607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1e8b6cb8-34ff-468f-8a33-94cf7ecf2523 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:49.088899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1e8b6cb8-34ff-468f-8a33-94cf7ecf2523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:49.113921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:49.170559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 459/920] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:49.193143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6270ca-ba54-432e-a6fb-b23386ce9cab None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:49.205875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:49.307086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6270ca-ba54-432e-a6fb-b23386ce9cab None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:49.344444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:49.345124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.345396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.345675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.346307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:49.347795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:49.358431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:49.359451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:49.360293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 462/921] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:49.366400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b6cb8-34ff-468f-8a33-94cf7ecf2523 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:49.467324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b6cb8-34ff-468f-8a33-94cf7ecf2523 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:49.502307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:49.503009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.503235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.503515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.504210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:49.504510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:49.506016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:49.511509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 460/922] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:49.517198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:49.592549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:49.625316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b275e5-3d61-47f3-8552-2eccb4995e4a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:49.663136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcad15-ca0c-4aea-a2d3-56c41863c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:49.663771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcad15-ca0c-4aea-a2d3-56c41863c34b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.664051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcad15-ca0c-4aea-a2d3-56c41863c34b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.664327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcad15-ca0c-4aea-a2d3-56c41863c34b None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.665020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcad15-ca0c-4aea-a2d3-56c41863c34b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:49.665350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcad15-ca0c-4aea-a2d3-56c41863c34b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:49.666741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcad15-ca0c-4aea-a2d3-56c41863c34b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:49.672293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 463/923] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:49.678241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:49.697037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:49.759699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4111fb3-b105-4b45-964e-2f67e38029d9 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.759876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4111fb3-b105-4b45-964e-2f67e38029d9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.760162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4111fb3-b105-4b45-964e-2f67e38029d9 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.761912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 464/924] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:49.766822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f899c-8a3d-45e9-8755-61a8dbf9c221 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.767109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f899c-8a3d-45e9-8755-61a8dbf9c221 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.767385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f899c-8a3d-45e9-8755-61a8dbf9c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.785764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fa2f899c-8a3d-45e9-8755-61a8dbf9c221 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:49.786440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60482bd-8209-46c6-b4de-63d020e9e349 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:49.786941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fa2f899c-8a3d-45e9-8755-61a8dbf9c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:49.821369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:49.822002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.822287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.822563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.823326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] RBAC: Adding query filter params (interface=public, service_id=bf201f51556e43f699fff3aa8ba10635, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:49.823703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:49.825109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:49.830754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 461/925] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:19:49 2022] GET /identity/v3/endpoints?service_id=bf201f51556e43f699fff3aa8ba10635&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:49.836245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:49.869380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 465/926] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:49.883523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f899c-8a3d-45e9-8755-61a8dbf9c221 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:49.936418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf0d83-70bb-426a-8f0e-0ff0ab90a669 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:49.938297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:49.949523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:49.973954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:49.974566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:49.974849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:49.975125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:49.975782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:49.977393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:49.989611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 462/927] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:19:49 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:19:49.990169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f899c-8a3d-45e9-8755-61a8dbf9c221 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:50.031682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:50.032763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:50.033313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:50.033826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:50.034670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:50.036298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:50.047134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:50.048225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 08:19:50.049070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:50.052207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 466/928] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Jul 29 08:19:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:50.059432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:50.178551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca5933-8dab-4f1f-9668-4e3576e89715 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:50.214922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:50.215554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:50.215837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:50.216111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:50.216794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:50.217098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:50.218542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:50.223744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 463/929] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:50.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:50.339994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfda0e-00a0-4134-9622-5c9765f13a24 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:50.369411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:50.376307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d653502-9127-4254-bf21-720dd864c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:50.377203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d653502-9127-4254-bf21-720dd864c163 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:50.377764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d653502-9127-4254-bf21-720dd864c163 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:50.378268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d653502-9127-4254-bf21-720dd864c163 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:50.379148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d653502-9127-4254-bf21-720dd864c163 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:50.379655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d653502-9127-4254-bf21-720dd864c163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:50.381294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d653502-9127-4254-bf21-720dd864c163 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:50.387138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 467/930] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:50.392602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:50.404315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:50.497810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd952-a13f-43a6-8322-996120e9bb82 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:50.534740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19759-66c9-499a-994a-817cf9e649f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:50.535764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19759-66c9-499a-994a-817cf9e649f3 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:50.536181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19759-66c9-499a-994a-817cf9e649f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:50.536602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19759-66c9-499a-994a-817cf9e649f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:50.537474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c19759-66c9-499a-994a-817cf9e649f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:50.539010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c19759-66c9-499a-994a-817cf9e649f3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:50.560522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 464/931] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:19:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:50.583813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a48cf-06a2-48b5-bc5a-b6014fb75653 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:50.584112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a48cf-06a2-48b5-bc5a-b6014fb75653 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:50.584402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a48cf-06a2-48b5-bc5a-b6014fb75653 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:50.586233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 468/932] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:50.592615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b022d0-65a8-4280-8505-bbe59a5614cd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:50.592812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b022d0-65a8-4280-8505-bbe59a5614cd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:50.593081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b022d0-65a8-4280-8505-bbe59a5614cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:50.612674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-54b022d0-65a8-4280-8505-bbe59a5614cd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:50.613941 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-54b022d0-65a8-4280-8505-bbe59a5614cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:50.682097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:50.699259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 465/933] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:50.722978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a48cf-06a2-48b5-bc5a-b6014fb75653 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:50.834728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a48cf-06a2-48b5-bc5a-b6014fb75653 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:50.873189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:50.874189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:50.874649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:50.875097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:50.887772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:50.892965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:50.893999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:19:50.894905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:50.897236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 469/934] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Jul 29 08:19:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:50.902989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b022d0-65a8-4280-8505-bbe59a5614cd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.010311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b022d0-65a8-4280-8505-bbe59a5614cd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.046366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75f4c1-4a5c-45b3-82f2-2badce2598fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.047008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f4c1-4a5c-45b3-82f2-2badce2598fe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.047291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f4c1-4a5c-45b3-82f2-2badce2598fe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.047570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f4c1-4a5c-45b3-82f2-2badce2598fe None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.048300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75f4c1-4a5c-45b3-82f2-2badce2598fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:51.048607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75f4c1-4a5c-45b3-82f2-2badce2598fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.050031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75f4c1-4a5c-45b3-82f2-2badce2598fe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.058863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 466/935] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Jul 29 08:19:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:51.066635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.125317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:51.175907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86266712-3d1b-4eeb-8051-39b82edf8e43 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.176194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86266712-3d1b-4eeb-8051-39b82edf8e43 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.176473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86266712-3d1b-4eeb-8051-39b82edf8e43 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.177994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914510-a2d6-4114-8810-490db4500149 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.178865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 467/936] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:51.184751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b27c5-249b-4010-a11d-e90efa4726a4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.185035 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b27c5-249b-4010-a11d-e90efa4726a4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.185353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b27c5-249b-4010-a11d-e90efa4726a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.206775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bb6b27c5-249b-4010-a11d-e90efa4726a4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:51.208109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bb6b27c5-249b-4010-a11d-e90efa4726a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:51.226863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.228105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.229021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.229467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.245846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.248214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:51.266989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:51.268115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:51.269188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:51.269188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:51.269188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:51.269188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:51.270866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 470/937] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:51.276470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.278356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:51.306314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 468/938] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:51.328989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b27c5-249b-4010-a11d-e90efa4726a4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.409413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d69d1-48c5-4577-839a-c704df4f4fb6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.419925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:51.454222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b27c5-249b-4010-a11d-e90efa4726a4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.457613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.458480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.458959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.459463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.460409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:51.460921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.462997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.478189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 471/939] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:51.484662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.496212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.496849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.497132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.497781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.498248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.499695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.502557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING keystone.server.flask.common [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 29 08:19:51.524022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.sql.core [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 08:19:51.524022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 29 08:19:51.524022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [parameters: {'id': 'c90a3e2aab9c49fc811950230a0bbfe6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 29 08:19:51.524022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c90a3e2aab9c49fc811950230a0bbfe6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c90a3e2aab9c49fc811950230a0bbfe6. Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 08:19:51.543884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 29 08:19:51.544771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application yield resource Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise self.value Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application session.commit() Jul 29 08:19:51.546267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.flush() Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application compat.raise_( Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 08:19:51.547173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 08:19:51.548062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 08:19:51.548841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [parameters: {'id': 'c90a3e2aab9c49fc811950230a0bbfe6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:51.550666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:51.552699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c90a3e2aab9c49fc811950230a0bbfe6. Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 469/940] 10.222.0.47 () {60 vars in 1140 bytes} [Fri Jul 29 08:19:51 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:51.555023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.597703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:51.630088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da30a8c-bce2-46e1-814e-18c916577aec None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.666695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54009dca-a1c4-4319-a971-8544406d98cf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.675292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.676656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.677135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.678049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.688782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.691124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.702667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.703320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.703603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.703926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:51.707780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:51.708715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:51.709715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:51.711773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.717325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.717929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 472/941] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:19:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:51.719934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:51.734390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:51.735385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:51.736295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:51.740666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 470/942] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:51.741529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:51.760120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:51.857125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:51.861261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58537c4c-43fe-4778-a37b-8c7b2f8c4fde None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.871695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d125fe3-0c69-4ced-9fd9-f85c6bdee8dd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:51.897781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.898421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.898694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.898972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.899698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:51.900002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.901483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.920478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b90b3f-02e3-446a-bc32-214c3fc92ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:51.921431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90b3f-02e3-446a-bc32-214c3fc92ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:51.921924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90b3f-02e3-446a-bc32-214c3fc92ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:51.922554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90b3f-02e3-446a-bc32-214c3fc92ec4 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:51.923614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b90b3f-02e3-446a-bc32-214c3fc92ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:51.924124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b90b3f-02e3-446a-bc32-214c3fc92ec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:51.925840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b90b3f-02e3-446a-bc32-214c3fc92ec4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:51.929795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 471/943] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:51.948425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 473/944] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Jul 29 08:19:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:51.954640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.069104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb804cd7-9c45-41bc-8c13-e9d4c6ff8e5d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.105764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.106806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.107306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.107789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.118898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.120722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.129862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a860-788e-4a83-8086-73a395e931e7 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.130155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a860-788e-4a83-8086-73a395e931e7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.130444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a860-788e-4a83-8086-73a395e931e7 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.132070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 474/945] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:19:52.137463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910895-43bc-4d6c-b3fe-5d545ec60600 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.137753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910895-43bc-4d6c-b3fe-5d545ec60600 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.138031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910895-43bc-4d6c-b3fe-5d545ec60600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:52.138375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:52.139216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:52.140103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:52.140103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:52.140103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:52.140103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:52.142195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 472/946] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:52.148774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.160660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-75910895-43bc-4d6c-b3fe-5d545ec60600 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:52.162446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-75910895-43bc-4d6c-b3fe-5d545ec60600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:52.163051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:52.262499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 475/947] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:19:52.267678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cabec9-0ef0-4068-a4c1-8d2bf7a31b04 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.285984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75910895-43bc-4d6c-b3fe-5d545ec60600 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.302111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:52.306047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.306978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.307436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.307888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.309703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:52.310151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.311837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.325770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 473/948] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:52.331579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.392848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75910895-43bc-4d6c-b3fe-5d545ec60600 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.402199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:52.437159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.437856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.438148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.438428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.439066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.439171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0a17b-7df4-447d-82b8-941367d79d37 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.440508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:52.452813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:52.453924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:52.454770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:52.457348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 476/949] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:52.461199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.483017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.484349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.484851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.485372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.492538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.494265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:52.509598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:52.510509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:52.511435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:52.518566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 474/950] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:52.519750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.559848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:52.585380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5af9e9-ef00-413e-a95e-bf89fb6c8e78 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.621555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.622536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.623010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.623506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.624371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:52.624864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.626650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.631719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4fe36-f10c-4010-bc50-79a08855989a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.632478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 477/951] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:52.637828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.674826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:52.684672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006fa90-50c2-40f5-84a5-4b129524a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.685710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006fa90-50c2-40f5-84a5-4b129524a9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.686430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006fa90-50c2-40f5-84a5-4b129524a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.687798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006fa90-50c2-40f5-84a5-4b129524a9c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.688767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006fa90-50c2-40f5-84a5-4b129524a9c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:52.689273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006fa90-50c2-40f5-84a5-4b129524a9c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.691261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006fa90-50c2-40f5-84a5-4b129524a9c6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.705480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 475/952] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:52.707155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3846b75-3598-4e51-8f6f-74528bc41849 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.707632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3846b75-3598-4e51-8f6f-74528bc41849 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.708086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3846b75-3598-4e51-8f6f-74528bc41849 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.709505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 476/953] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:52.711175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3846b75-3598-4e51-8f6f-74528bc41849 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.766604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798c134-8318-4033-ac0b-e6ece596820f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.802468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cdc37-bc89-4b82-b8a5-cfb2f81063a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.803103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cdc37-bc89-4b82-b8a5-cfb2f81063a9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.803426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cdc37-bc89-4b82-b8a5-cfb2f81063a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.803707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cdc37-bc89-4b82-b8a5-cfb2f81063a9 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.804394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cdc37-bc89-4b82-b8a5-cfb2f81063a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:52.804701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cdc37-bc89-4b82-b8a5-cfb2f81063a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.806112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cdc37-bc89-4b82-b8a5-cfb2f81063a9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.811779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 478/954] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:52.813007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5aa0e-baff-4cb4-98de-ed0a98d08a4e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.813318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5aa0e-baff-4cb4-98de-ed0a98d08a4e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.813599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5aa0e-baff-4cb4-98de-ed0a98d08a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.818954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3846b75-3598-4e51-8f6f-74528bc41849 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:52.826704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:52.832341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f1d5aa0e-baff-4cb4-98de-ed0a98d08a4e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:52.833634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f1d5aa0e-baff-4cb4-98de-ed0a98d08a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:52.859079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:52.859746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:52.860025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:52.860295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e7576c5e6d64401bba9e8d23ca0c638b/roles/ed22fd6ead7c4837a429f5150feb8fe3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:52.862705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=e7576c5e6d64401bba9e8d23ca0c638b, role_id=ed22fd6ead7c4837a429f5150feb8fe3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:52.864158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:52.877897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 477/955] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:19:52 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/e7576c5e6d64401bba9e8d23ca0c638b/roles/ed22fd6ead7c4837a429f5150feb8fe3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:19:52.878672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.925859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 479/956] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:52.943734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5aa0e-baff-4cb4-98de-ed0a98d08a4e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:52.949170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:53.016801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ce33-36a1-437a-b6f4-2212e5b2b0a5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:53.065886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:53.066525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:53.066804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:53.067074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:53.067799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:53.069187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:53.075738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5aa0e-baff-4cb4-98de-ed0a98d08a4e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:53.095445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 478/957] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:19:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:53.122642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:53.128299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:53.129094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:53.129467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:53.129826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:53.130552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:53.132101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:53.143219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:53.144398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:19:53.145314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:53.148974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 480/958] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:53.152208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:53.271141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f54e1-7d56-429c-a582-14d6d83c0014 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:53.278963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:53.309380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db96c89-e9b1-42e1-b787-36650cfa9e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:53.309960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96c89-e9b1-42e1-b787-36650cfa9e85 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:53.310244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96c89-e9b1-42e1-b787-36650cfa9e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:53.310521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96c89-e9b1-42e1-b787-36650cfa9e85 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:53.311210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db96c89-e9b1-42e1-b787-36650cfa9e85 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:53.311515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db96c89-e9b1-42e1-b787-36650cfa9e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:53.312909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db96c89-e9b1-42e1-b787-36650cfa9e85 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:53.321362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 479/959] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:53.325081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:53.439301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faf17b-a875-4c08-be58-9cf03e919f5e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:53.474819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69156be4-a429-4ac0-be02-c427279b05a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:53.475498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156be4-a429-4ac0-be02-c427279b05a1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:53.475831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156be4-a429-4ac0-be02-c427279b05a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:53.476152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156be4-a429-4ac0-be02-c427279b05a1 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:53.476840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69156be4-a429-4ac0-be02-c427279b05a1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:53.477141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69156be4-a429-4ac0-be02-c427279b05a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:53.478546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69156be4-a429-4ac0-be02-c427279b05a1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:53.483792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 481/960] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:54.067056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0365-96d9-4b04-b2a6-bfdb5d45f89d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:54.067629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0365-96d9-4b04-b2a6-bfdb5d45f89d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:54.067629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0365-96d9-4b04-b2a6-bfdb5d45f89d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:54.069234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 480/961] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:54.074312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f937d6-8df0-4b90-a152-ef8de7a4bc07 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:54.074607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f937d6-8df0-4b90-a152-ef8de7a4bc07 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:54.074886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f937d6-8df0-4b90-a152-ef8de7a4bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:54.095451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-18f937d6-8df0-4b90-a152-ef8de7a4bc07 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:54.096679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-18f937d6-8df0-4b90-a152-ef8de7a4bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:54.160221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:54.172385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 482/962] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:54.196646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0365-96d9-4b04-b2a6-bfdb5d45f89d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:54.306142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0365-96d9-4b04-b2a6-bfdb5d45f89d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:54.340649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:54.341320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:54.341590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:54.341924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:54.342615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:54.344053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:54.360297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.sql.core [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 08:19:54.360297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 29 08:19:54.360297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [parameters: {'user_id': 'bdb68d97831f42f1bffb3a70a5180e35', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 29 08:19:54.360297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Jul 29 08:19:54.368882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 08:19:54.369777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application yield resource Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise self.value Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application session.commit() Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 08:19:54.370812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.flush() Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application compat.raise_( Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 08:19:54.371810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 08:19:54.372727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 08:19:54.374876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bdb68d97831f42f1bffb3a70a5180e35', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:54.376839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 29 08:19:54.378722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 29 08:19:54.385898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 29 08:19:54.385898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 29 08:19:54.385898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 08:19:54.385898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 08:19:54.385898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 29 08:19:54.385898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:54.385898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 481/963] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Jul 29 08:19:54 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:54.386821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f937d6-8df0-4b90-a152-ef8de7a4bc07 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:54.488705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f937d6-8df0-4b90-a152-ef8de7a4bc07 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:54.523795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef282b-283e-4c5c-ba50-0b40bfe12ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:54.524456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef282b-283e-4c5c-ba50-0b40bfe12ceb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:54.525099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef282b-283e-4c5c-ba50-0b40bfe12ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:54.525405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef282b-283e-4c5c-ba50-0b40bfe12ceb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:54.533019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef282b-283e-4c5c-ba50-0b40bfe12ceb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:54.534562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef282b-283e-4c5c-ba50-0b40bfe12ceb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e2ef282b-283e-4c5c-ba50-0b40bfe12ceb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:54.546563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:54.548718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:54.550961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 483/964] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:19:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:54.558418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:54.596453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:54.669424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1787d-1bc3-4bf1-8468-b584799aa2bb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:54.703376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413fc65-9ce8-47d8-ba29-0971a99d67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:54.704011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413fc65-9ce8-47d8-ba29-0971a99d67fb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:54.704293 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413fc65-9ce8-47d8-ba29-0971a99d67fb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:54.704571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413fc65-9ce8-47d8-ba29-0971a99d67fb None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:54.705361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413fc65-9ce8-47d8-ba29-0971a99d67fb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:54.705667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413fc65-9ce8-47d8-ba29-0971a99d67fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:54.707331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413fc65-9ce8-47d8-ba29-0971a99d67fb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:54.746254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 482/965] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Jul 29 08:19:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:55.058730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7646a-b0a0-41e1-a4f6-eed855151ae5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.058918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7646a-b0a0-41e1-a4f6-eed855151ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.059161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7646a-b0a0-41e1-a4f6-eed855151ae5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.060723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 484/966] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:55.066081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9c36d-778e-437f-93cc-403a159bd6c2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.066377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9c36d-778e-437f-93cc-403a159bd6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.066632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9c36d-778e-437f-93cc-403a159bd6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.085742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d2c9c36d-778e-437f-93cc-403a159bd6c2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:55.087253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d2c9c36d-778e-437f-93cc-403a159bd6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:55.159279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 483/967] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:55.172304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b37e-fa27-49fc-88fb-4a3f0e75f91f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.172699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b37e-fa27-49fc-88fb-4a3f0e75f91f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.173044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b37e-fa27-49fc-88fb-4a3f0e75f91f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.174528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 485/968] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:55.179909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf1c8-6222-4c2b-8371-d3999da0811a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.180202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf1c8-6222-4c2b-8371-d3999da0811a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.180485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf1c8-6222-4c2b-8371-d3999da0811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.182026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268b37e-fa27-49fc-88fb-4a3f0e75f91f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.200677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c46bf1c8-6222-4c2b-8371-d3999da0811a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:55.201916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c46bf1c8-6222-4c2b-8371-d3999da0811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:55.217370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:55.243811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:55.283561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 484/969] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:55.301576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268b37e-fa27-49fc-88fb-4a3f0e75f91f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.309989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf1c8-6222-4c2b-8371-d3999da0811a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.336056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.336713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.336995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.337315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.348319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:19:55.353212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:55.354177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:55.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 486/970] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:55.360302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.431003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf1c8-6222-4c2b-8371-d3999da0811a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.485202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8914c-92ee-4aa2-b311-52c9b8cad406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.486196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8914c-92ee-4aa2-b311-52c9b8cad406 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.486656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8914c-92ee-4aa2-b311-52c9b8cad406 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.487073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8914c-92ee-4aa2-b311-52c9b8cad406 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.488095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8914c-92ee-4aa2-b311-52c9b8cad406 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:55.490492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8914c-92ee-4aa2-b311-52c9b8cad406 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:55.491007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbc5d9-0e95-424e-8ab0-904b5a908273 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-41f8914c-92ee-4aa2-b311-52c9b8cad406 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:55.500770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:55.501979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:55.502850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 485/971] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:55.503973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2bba0-9748-429d-aa4b-55079c15f312 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.503973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2bba0-9748-429d-aa4b-55079c15f312 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.503973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2bba0-9748-429d-aa4b-55079c15f312 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.504812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 486/972] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:55.507454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:55.507576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2bba0-9748-429d-aa4b-55079c15f312 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.523823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:55.533064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7c91-ad50-4269-a83b-a2c5f9163146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.533721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7c91-ad50-4269-a83b-a2c5f9163146 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.534001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7c91-ad50-4269-a83b-a2c5f9163146 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.534274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7c91-ad50-4269-a83b-a2c5f9163146 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.534985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7c91-ad50-4269-a83b-a2c5f9163146 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:55.535287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7c91-ad50-4269-a83b-a2c5f9163146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:55.536650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7c91-ad50-4269-a83b-a2c5f9163146 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:55.544391 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 487/973] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:55.545570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb880-84bf-4830-b031-e4beb5089801 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.545854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb880-84bf-4830-b031-e4beb5089801 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.546133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb880-84bf-4830-b031-e4beb5089801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.563216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8bceb880-84bf-4830-b031-e4beb5089801 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:55.564332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8bceb880-84bf-4830-b031-e4beb5089801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:55.615322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2bba0-9748-429d-aa4b-55079c15f312 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.631332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 488/974] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:55.632154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb880-84bf-4830-b031-e4beb5089801 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.650391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.651017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.651291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.651621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.652292 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:55.652592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:55.654007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:55.659861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 487/975] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:55.659861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.734233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:55.739417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb880-84bf-4830-b031-e4beb5089801 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.740921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:55.756087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c40e2-b4c5-4a61-99c7-61941cc88b9c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.775157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.775823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.776091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.776451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.786362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:55.787822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:55.788625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.789238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.789546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.789837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.790515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:55.791869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:55.802871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:55.803815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:55.804709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:55.804709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:55.804709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:55.804709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:55.804709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 489/976] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:55.804994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.810307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 488/977] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:19:55 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:55.811160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:55.933163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf76c-9869-474c-a345-8e9190cd5f8d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.937683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2408-d91a-4114-af67-1519b56fc375 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:55.977952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.978633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.979252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.979478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.980609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:55.980819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:55.981419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:55.981654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:55.981937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:55.982215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:55.983612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:55.983612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:55.984007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:55.984740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:55.986629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:55.992238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 490/978] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:55.999684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:56.004649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 489/979] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:56.010432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:56.021754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:56.112582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e642e9-64a5-48c0-a902-3481d56fe0f3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:56.117182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee33b0-3068-4cda-a034-8ed5731503c4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:56.148598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:56.149226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:56.149534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:56.149807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:56.150571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] RBAC: Adding query filter params (interface=admin, service_id=bf201f51556e43f699fff3aa8ba10635, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:56.150883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:56.152374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:56.153031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:56.153389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:56.153755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:56.155067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:56.162241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:56.168074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 491/980] 10.222.0.47 () {56 vars in 1249 bytes} [Fri Jul 29 08:19:55 2022] GET /identity/v3/endpoints?service_id=bf201f51556e43f699fff3aa8ba10635&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:56.168203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:56.168857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:19:56.176399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:56.177343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 08:19:56.178416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:56.181735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 490/981] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:19:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:56.183297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:56.242504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:56.272163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:56.292464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314e556-cca5-45e4-aa90-8ca77b65cd8b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:56.293113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1e6de-e1bd-42e7-9636-f850eadc5ac3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:56.327168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:56.327794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:56.328072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:56.328344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:56.328917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:56.329133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:56.329467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:56.329577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:56.329838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:56.330114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:56.330758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:56.330908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:56.332114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:56.339387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 492/982] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:19:56 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:19:56.351205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 491/983] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Jul 29 08:19:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:56.357112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:56.472025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af47516-7226-4921-bdb5-c64be742f3fe None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:56.510047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:56.510720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:56.511002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:56.511281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:56.527698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:56.582241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:56.583690 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:56.686351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 493/984] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:19:56 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:19:56.691853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:56.790779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e800e-d0cc-4c2a-a67c-4e8c5eea56a9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:56.804231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:56.826527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:56.827172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:56.827449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:56.827717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:56.837838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:56.839676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:19:56.854611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:56.855534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:56.856448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:19:56.856448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:19:56.856448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:19:56.856448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:56.857617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 492/985] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:56.861405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:56.909891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:56.969106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15f9d-ca4a-4a19-a20f-2255a7ec7c88 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:57.004859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:57.005487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:57.005776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:57.006085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:57.006816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:57.007126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:57.008721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:57.020790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 494/986] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:57.026463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:57.128731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779ca4-5a49-4847-8e5b-38a80d852f83 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:57.161666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:57.162314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:57.162597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:57.162873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:57.169669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:57.171137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:19:57.182337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:57.183284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:19:57.184175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:57.185647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 493/987] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:57.189315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:57.300738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d722b59-d2e5-4412-b764-70ff1ed74121 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:57.308493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:57.337146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faed509-b5ad-4ac6-8187-c6ee140999fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:57.337823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed509-b5ad-4ac6-8187-c6ee140999fe None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:57.338101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed509-b5ad-4ac6-8187-c6ee140999fe None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:57.338375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed509-b5ad-4ac6-8187-c6ee140999fe None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:57.339623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faed509-b5ad-4ac6-8187-c6ee140999fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:57.339936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faed509-b5ad-4ac6-8187-c6ee140999fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:57.341454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faed509-b5ad-4ac6-8187-c6ee140999fe None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:57.358962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 495/988] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:57.360278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:57.387612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:57.469937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4a5d2-6918-476e-81a4-d7becb9aa4ed None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:57.504417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7935c3-8ed5-40f1-9eec-66096143df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:57.505046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7935c3-8ed5-40f1-9eec-66096143df78 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:57.505346 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7935c3-8ed5-40f1-9eec-66096143df78 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:57.505621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7935c3-8ed5-40f1-9eec-66096143df78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:57.506416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7935c3-8ed5-40f1-9eec-66096143df78 None admin] RBAC: Adding query filter params (role.id=ed22fd6ead7c4837a429f5150feb8fe3, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=e7576c5e6d64401bba9e8d23ca0c638b) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:57.506723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7935c3-8ed5-40f1-9eec-66096143df78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:57.508169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7935c3-8ed5-40f1-9eec-66096143df78 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:57.521365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 494/989] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:19:57 2022] GET /identity/v3/role_assignments?user.id=e7576c5e6d64401bba9e8d23ca0c638b&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=ed22fd6ead7c4837a429f5150feb8fe3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:57.810617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbab15-71d1-4c9c-814c-f714c99890e0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:57.811142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbab15-71d1-4c9c-814c-f714c99890e0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:57.811142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbab15-71d1-4c9c-814c-f714c99890e0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:57.812596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 496/990] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:57.817629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5926a-2deb-486f-85e3-12c9a7b256c6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:57.817919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5926a-2deb-486f-85e3-12c9a7b256c6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:57.818204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5926a-2deb-486f-85e3-12c9a7b256c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:57.836936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-21e5926a-2deb-486f-85e3-12c9a7b256c6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:57.838165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21e5926a-2deb-486f-85e3-12c9a7b256c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:57.907699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 495/991] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:57.929339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbab15-71d1-4c9c-814c-f714c99890e0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.048627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbab15-71d1-4c9c-814c-f714c99890e0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.083100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.083655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.083930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.084207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.084859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.086247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:58.095575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:58.096549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:19:58.097446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:58.099012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 497/992] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:19:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:58.102825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5926a-2deb-486f-85e3-12c9a7b256c6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.121518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:58.204716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5926a-2deb-486f-85e3-12c9a7b256c6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.244612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344571e6-b5d5-4d85-9c96-d289b714d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.245312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344571e6-b5d5-4d85-9c96-d289b714d012 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.245590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344571e6-b5d5-4d85-9c96-d289b714d012 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.245862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344571e6-b5d5-4d85-9c96-d289b714d012 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.246537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344571e6-b5d5-4d85-9c96-d289b714d012 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:58.246833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344571e6-b5d5-4d85-9c96-d289b714d012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.250141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344571e6-b5d5-4d85-9c96-d289b714d012 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.256235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 496/993] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:58.261723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.296103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:58.350765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc982-b95d-436d-a32f-49297835ea19 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.351110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc982-b95d-436d-a32f-49297835ea19 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.351322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc982-b95d-436d-a32f-49297835ea19 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.352765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 497/994] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:58.358395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40a4c-dcdb-47a2-a886-892f6b5f65de None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.358685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40a4c-dcdb-47a2-a886-892f6b5f65de None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.358936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40a4c-dcdb-47a2-a886-892f6b5f65de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.367109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007f6b-a62d-44ac-8d33-0c1b932b6baf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.377926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-17b40a4c-dcdb-47a2-a886-892f6b5f65de None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:58.379116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-17b40a4c-dcdb-47a2-a886-892f6b5f65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:58.402798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.403425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.403714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.403989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.404695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:58.404986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.406383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.411357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 498/995] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:19:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:58.417077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.449524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 498/996] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:58.470833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b40a4c-dcdb-47a2-a886-892f6b5f65de None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.492139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:58.515516 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:58.522732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b52f-1542-463d-b5c7-bea4c6003818 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.556620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.557261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.557602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.557878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.558635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] RBAC: Adding query filter params (interface=public, service_id=9bd46c480a2949cdb3b5e9edc943b2c0, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:58.558941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.560354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.569834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 499/997] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:19:58 2022] GET /identity/v3/endpoints?service_id=9bd46c480a2949cdb3b5e9edc943b2c0&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:58.570838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.590965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b40a4c-dcdb-47a2-a886-892f6b5f65de None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.627984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.627984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.628258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.628539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.629189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.631735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:58.640991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:58.642060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:19:58.642986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 499/998] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Jul 29 08:19:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:19:58.648168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.682027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee8434-fea3-4b9f-b86f-8b1d97e68090 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.717834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.718799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.719300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.719736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.720396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.721799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.727113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:58.729681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 500/999] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:19:58 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:19:58.756884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76d7b4-8e2c-4fcb-b89c-640d3622823a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.795483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.796439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.796865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.797308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.798180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:58.798644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.800205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.806403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 500/1000] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:19:58.812472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:58.843095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:58.926683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d20d5a-bfdd-462d-9d74-375c9f88c94a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:58.962599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3b52-8cca-4fd7-9c32-4bc7bd914887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:58.963235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3b52-8cca-4fd7-9c32-4bc7bd914887 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:58.963518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3b52-8cca-4fd7-9c32-4bc7bd914887 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:58.964177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3b52-8cca-4fd7-9c32-4bc7bd914887 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:58.964866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d3b52-8cca-4fd7-9c32-4bc7bd914887 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:58.965174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d3b52-8cca-4fd7-9c32-4bc7bd914887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:58.966581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d3b52-8cca-4fd7-9c32-4bc7bd914887 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:58.971950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 501/1001] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Jul 29 08:19:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:58.977793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:59.084570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039ec8-5212-482a-a832-9673cd4cba22 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:59.118866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082bbf2-5225-443a-943c-a6c6e68fd28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:59.119490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082bbf2-5225-443a-943c-a6c6e68fd28d None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:59.119771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082bbf2-5225-443a-943c-a6c6e68fd28d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:59.120072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082bbf2-5225-443a-943c-a6c6e68fd28d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:59.120778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082bbf2-5225-443a-943c-a6c6e68fd28d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:59.122203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082bbf2-5225-443a-943c-a6c6e68fd28d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:59.136406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:59.149945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 501/1002] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:19:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:19:59.522000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c91f-ec1b-4892-97fb-8881178bdec0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:59.522194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c91f-ec1b-4892-97fb-8881178bdec0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:59.522485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c91f-ec1b-4892-97fb-8881178bdec0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:59.524026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 502/1003] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:19:59.529046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811b481-a380-470f-8b32-6c18f3f898ed None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:59.529567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811b481-a380-470f-8b32-6c18f3f898ed None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:59.529660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811b481-a380-470f-8b32-6c18f3f898ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:59.548818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9811b481-a380-470f-8b32-6c18f3f898ed None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:19:59.550089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9811b481-a380-470f-8b32-6c18f3f898ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:19:59.626282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 502/1004] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:19:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:19:59.652270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c91f-ec1b-4892-97fb-8881178bdec0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:59.741958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:59.759383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c91f-ec1b-4892-97fb-8881178bdec0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:59.793704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:59.794275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:59.794556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:59.794835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] PATH_INFO: `/v3/services/image` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:59.795468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:59.796836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:19:59.805826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:19:59.806794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:19:59.807741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:19:59.809372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 503/1005] 10.222.0.47 () {56 vars in 1105 bytes} [Fri Jul 29 08:19:59 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:19:59.813485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811b481-a380-470f-8b32-6c18f3f898ed None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:19:59.918920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811b481-a380-470f-8b32-6c18f3f898ed None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:19:59.945207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:19:59.955197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a2417-f218-480e-8b44-f10f43f1917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:19:59.955825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a2417-f218-480e-8b44-f10f43f1917e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:19:59.956105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a2417-f218-480e-8b44-f10f43f1917e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:19:59.956384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a2417-f218-480e-8b44-f10f43f1917e None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:19:59.957061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a2417-f218-480e-8b44-f10f43f1917e None admin] RBAC: Adding query filter params (name=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:19:59.957393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a2417-f218-480e-8b44-f10f43f1917e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:19:59.958785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a2417-f218-480e-8b44-f10f43f1917e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:19:59.968808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 503/1006] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:19:59.970037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:00.073679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518f53-4926-437d-82cd-4c013b8ad697 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:00.107746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513f2f2-4960-4416-8829-c93b055d330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:00.108370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513f2f2-4960-4416-8829-c93b055d330d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:00.108655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513f2f2-4960-4416-8829-c93b055d330d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:00.108932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513f2f2-4960-4416-8829-c93b055d330d None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:00.109643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513f2f2-4960-4416-8829-c93b055d330d None admin] RBAC: Adding query filter params (type=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:00.109932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513f2f2-4960-4416-8829-c93b055d330d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:00.111313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513f2f2-4960-4416-8829-c93b055d330d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:00.116018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 504/1007] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:19:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:00.715394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0761-edb6-47a4-8b4d-93b3000dc755 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:00.715955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0761-edb6-47a4-8b4d-93b3000dc755 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:00.715955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0761-edb6-47a4-8b4d-93b3000dc755 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:00.717271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 504/1008] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:00.722751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ed3e-6e0b-4e60-a619-e8b8b0176cea None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:00.723004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ed3e-6e0b-4e60-a619-e8b8b0176cea None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:00.723318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ed3e-6e0b-4e60-a619-e8b8b0176cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:00.741904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4cd1ed3e-6e0b-4e60-a619-e8b8b0176cea None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:00.743091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4cd1ed3e-6e0b-4e60-a619-e8b8b0176cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:00.753137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:00.813574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 505/1009] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:00.835755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0761-edb6-47a4-8b4d-93b3000dc755 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:00.941563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0761-edb6-47a4-8b4d-93b3000dc755 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:00.976508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:00.977074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:00.977372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:00.977644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:00.978259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:00.979731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:00.988518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:00.989495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 08:20:00.990336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:00.993660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 505/1010] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:20:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:00.995934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1ed3e-6e0b-4e60-a619-e8b8b0176cea None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:01.099079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1ed3e-6e0b-4e60-a619-e8b8b0176cea None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:01.134525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaf2a6-9b7a-4990-9187-b785584b9f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:01.135587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf2a6-9b7a-4990-9187-b785584b9f3d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:01.136041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf2a6-9b7a-4990-9187-b785584b9f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:01.136484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf2a6-9b7a-4990-9187-b785584b9f3d None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:01.137363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaf2a6-9b7a-4990-9187-b785584b9f3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:01.137859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaf2a6-9b7a-4990-9187-b785584b9f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:01.139493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaf2a6-9b7a-4990-9187-b785584b9f3d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:01.149155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 506/1011] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:20:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:01.150672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:01.162497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cf2b6-7bd6-4dd4-a3e8-a3b34206ac6b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:01.162880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cf2b6-7bd6-4dd4-a3e8-a3b34206ac6b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:01.163163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cf2b6-7bd6-4dd4-a3e8-a3b34206ac6b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:01.164524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 507/1012] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:01.169651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61240644-ed35-4655-bf51-1ad2612a963e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:01.170096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61240644-ed35-4655-bf51-1ad2612a963e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:01.170409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61240644-ed35-4655-bf51-1ad2612a963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:01.188513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-61240644-ed35-4655-bf51-1ad2612a963e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:01.189730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-61240644-ed35-4655-bf51-1ad2612a963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:01.191919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:01.211455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:01.266232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32952fe-97ab-4f22-997d-ec1d6dd2761f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:01.268517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 508/1013] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:01.290927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61240644-ed35-4655-bf51-1ad2612a963e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:01.307696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:01.308323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:01.308610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:01.308870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:01.309590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:01.309892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:01.311274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:01.316131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 506/1014] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Jul 29 08:20:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:01.321655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:01.406003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61240644-ed35-4655-bf51-1ad2612a963e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:01.434974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0839e-23b4-46f1-8402-a15391eb938b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:01.447414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:01.448103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:01.448387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:01.448663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:01.450513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:01.451325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:01.452940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 509/1015] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:01.458389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:01.458877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:01.468322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:01.477615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e3f22-d731-4c32-b7c1-f1404f42141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:01.478244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3f22-d731-4c32-b7c1-f1404f42141a None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:01.478524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3f22-d731-4c32-b7c1-f1404f42141a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:01.478802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3f22-d731-4c32-b7c1-f1404f42141a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:01.479545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e3f22-d731-4c32-b7c1-f1404f42141a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:01.481137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e3f22-d731-4c32-b7c1-f1404f42141a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:01.507398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 507/1016] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:20:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:20:01.584476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ee1f-10dd-43af-ba5d-4f1028424da0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:01.630038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833a141-8d8b-452a-8460-d66ccd80e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:01.630675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a141-8d8b-452a-8460-d66ccd80e71e None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:01.630944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a141-8d8b-452a-8460-d66ccd80e71e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:01.631219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a141-8d8b-452a-8460-d66ccd80e71e None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:01.631932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a141-8d8b-452a-8460-d66ccd80e71e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:01.633476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a141-8d8b-452a-8460-d66ccd80e71e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:01.667718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 510/1017] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:20:01 2022] POST /identity/v3/projects => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:20:02.096721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59e10-edf1-4d42-b941-0ba4bf6c971d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:02.097299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59e10-edf1-4d42-b941-0ba4bf6c971d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:02.097299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59e10-edf1-4d42-b941-0ba4bf6c971d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:02.098849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 508/1018] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:02.104036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db3aa-7f39-4436-8786-cf43323c3110 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:02.104529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db3aa-7f39-4436-8786-cf43323c3110 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:02.104780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db3aa-7f39-4436-8786-cf43323c3110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:02.123791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-893db3aa-7f39-4436-8786-cf43323c3110 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:02.125006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-893db3aa-7f39-4436-8786-cf43323c3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:02.178525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:02.198865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 511/1019] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:02 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:02.221431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59e10-edf1-4d42-b941-0ba4bf6c971d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:02.334436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59e10-edf1-4d42-b941-0ba4bf6c971d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:02.368596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577d1ca-c271-4c1f-9497-90a3d1cf778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:02.369140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577d1ca-c271-4c1f-9497-90a3d1cf778b None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:02.369452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577d1ca-c271-4c1f-9497-90a3d1cf778b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:02.369730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577d1ca-c271-4c1f-9497-90a3d1cf778b None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:02.370477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577d1ca-c271-4c1f-9497-90a3d1cf778b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:02.371894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577d1ca-c271-4c1f-9497-90a3d1cf778b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:02.397306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 509/1020] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:20:02 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:20:03.608520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a544a4-75f3-47e8-84ea-76acfff19279 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:03.609074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a544a4-75f3-47e8-84ea-76acfff19279 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:03.609074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a544a4-75f3-47e8-84ea-76acfff19279 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:03.610652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 512/1021] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:03.615905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6fb13-af52-4ecb-bb87-a68c897f9ab4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:03.616296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6fb13-af52-4ecb-bb87-a68c897f9ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:03.616559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6fb13-af52-4ecb-bb87-a68c897f9ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:03.635883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dce6fb13-af52-4ecb-bb87-a68c897f9ab4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:03.637100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dce6fb13-af52-4ecb-bb87-a68c897f9ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:03.665750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:03.680404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c718-f40d-47ee-b288-3b3919deeca1 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:03.680672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c718-f40d-47ee-b288-3b3919deeca1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:03.681149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c718-f40d-47ee-b288-3b3919deeca1 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:03.682843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 513/1022] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:20:03.687568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cfd05-82d2-4693-8cf0-82ba4809b1eb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:03.690761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cfd05-82d2-4693-8cf0-82ba4809b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:03.690761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cfd05-82d2-4693-8cf0-82ba4809b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:03.706110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b61cfd05-82d2-4693-8cf0-82ba4809b1eb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:03.707356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b61cfd05-82d2-4693-8cf0-82ba4809b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:03.719555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 510/1023] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:03.741965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6fb13-af52-4ecb-bb87-a68c897f9ab4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:03.781454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 514/1024] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:03.802930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cfd05-82d2-4693-8cf0-82ba4809b1eb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:03.842443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6fb13-af52-4ecb-bb87-a68c897f9ab4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:03.877665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:03.878237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:03.878513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:03.878801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:03.889511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:03.894400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:03.895360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:03.896242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 511/1025] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Jul 29 08:20:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:03.902506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:03.911354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cfd05-82d2-4693-8cf0-82ba4809b1eb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:03.926120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:03.929752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:03.948645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:03.949309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:03.949601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:03.949901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:03.951058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:03.952677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:03.954763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 515/1026] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:03.959892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.018245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2040e-2d93-4233-9489-d590e0de4d9e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.053796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.054782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.055312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.055753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.056707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:04.057168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.058756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0a72-5795-4260-8c62-1792c7a7e4c6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.058951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.068118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 512/1027] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Jul 29 08:20:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:04.073718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.099230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.099863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.100148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.100435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.101099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.102570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.125887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 516/1028] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:20:03 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:20:04.160399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:04.183577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f777db1-d056-40f9-8a08-e1285da6f032 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.222647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a339-894c-4e86-a058-2d0a61538a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.223441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a339-894c-4e86-a058-2d0a61538a20 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.223641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a339-894c-4e86-a058-2d0a61538a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.223849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a339-894c-4e86-a058-2d0a61538a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.241968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194a339-894c-4e86-a058-2d0a61538a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.243500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194a339-894c-4e86-a058-2d0a61538a20 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c194a339-894c-4e86-a058-2d0a61538a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:04.261580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:04.262640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:04.263529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:20:04.263529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:04.263529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:04.263529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:04.265453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 513/1029] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:04.269821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.313718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:04.374256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f120-18da-47c3-9810-1a218f6e594d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.374531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f120-18da-47c3-9810-1a218f6e594d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.374960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f120-18da-47c3-9810-1a218f6e594d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.376635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 514/1030] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:04.378576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db15e1-6ac0-4a49-a207-467660e2b4b2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.381803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb09d-f4cf-43be-a969-28a92bf81658 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.382277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb09d-f4cf-43be-a969-28a92bf81658 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.382717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb09d-f4cf-43be-a969-28a92bf81658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.400806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0e9bb09d-f4cf-43be-a969-28a92bf81658 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:04.402122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0e9bb09d-f4cf-43be-a969-28a92bf81658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:04.415188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.415748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.416032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.416317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.417092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:04.417438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.418825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.436796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 517/1031] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:04.437889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.477087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 515/1032] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:04.501802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bb09d-f4cf-43be-a969-28a92bf81658 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.547656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:04.552232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d808af-588d-4021-9ea7-74891df99417 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.564566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:04.588118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.589466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.589907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.590188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.598242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.599712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.604929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bb09d-f4cf-43be-a969-28a92bf81658 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:20:04.612846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:04.614334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:20:04.615504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:04.618925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 518/1033] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:04.619985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.646412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.647671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.648097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.648372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] PATH_INFO: `/v3/services/image` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.648995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.650411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:04.660804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:04.661875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:04.662743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 516/1034] 10.222.0.47 () {56 vars in 1105 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:04.668622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.727330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18da3-e1e3-4fb1-bb56-ee66a904ae18 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.763196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.763808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.764083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.764434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.765149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:04.765501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.766935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.775987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e5e92-6036-49c9-b3e4-f88c23412036 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.789309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 519/1035] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:04.791329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.806994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:04.810072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:04.817232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.818557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.818945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.819264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.819919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:04.820254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.821666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.827087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 517/1036] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:04.833251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:04.902462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b323-557e-42e5-b1b6-45bd2acaf1f9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.938597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.939123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad452df9-4e3f-43e6-b1c6-40db3ea32df0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:04.939237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.939406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.939684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.973647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:04.974274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:04.974553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:04.974823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:04.975493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:04.975793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:04.977163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:04.982226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 518/1037] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:04.987781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:05.008416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.009923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.029336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:05.044926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:05.092418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a9a23-afd3-431c-a6e0-18a4471cf6a1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:05.118194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 520/1038] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 08:20:05.125461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:05.138157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:05.139140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:05.139510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:05.142131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:05.142131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] RBAC: Adding query filter params (interface=public, service_id=0d3a6f4f9bfe4eec8b44d9eb2b8b31f6, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:05.142131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.142509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.149637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 519/1039] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:20:04 2022] GET /identity/v3/endpoints?service_id=0d3a6f4f9bfe4eec8b44d9eb2b8b31f6&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:05.155421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:05.233659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc9aed-e532-4032-b8d3-f28e4c5f5174 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:05.260903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:05.271515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532c928-1d6a-48bf-a11f-bd5da6dc1f13 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:05.281214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:05.281891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:05.282180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:05.282461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:05.292128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:05.294173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.295885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.310611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:05.311589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:05.312057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:05.312532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:05.313317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:05.314191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:05.315102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:20:05.315102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:05.315102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:05.315102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:05.315102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 521/1040] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:05.315383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.316424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.320051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:05.324948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 520/1041] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:20:05 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:20:05.438145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeb005-c48e-45e1-a7d4-2414c712405d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:05.478096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:05.478096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:05.478397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:05.478473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:05.479176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:05.480019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.481738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.496825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 522/1042] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:05.502441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:05.606596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cb3fa-680b-4e04-bcfb-ec11b6341aeb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:05.639731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:05.640383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:05.640656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:05.640928 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:05.647797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.649260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:20:05.660614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:05.661773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:05.663116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 521/1043] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:05.667928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:05.696393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:05.769539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4757c-0b90-4512-99ae-742b208025fd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:05.805215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994486e5-d5df-4dcb-80d0-cc63cf3a2ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:05.805881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994486e5-d5df-4dcb-80d0-cc63cf3a2ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:05.806159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994486e5-d5df-4dcb-80d0-cc63cf3a2ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:05.806433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994486e5-d5df-4dcb-80d0-cc63cf3a2ef4 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:05.807198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994486e5-d5df-4dcb-80d0-cc63cf3a2ef4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:05.807504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994486e5-d5df-4dcb-80d0-cc63cf3a2ef4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.808946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994486e5-d5df-4dcb-80d0-cc63cf3a2ef4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.821073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 523/1044] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:05.827263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:05.874261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:05.930357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b98c-2346-494d-956c-be36a24e3683 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:05.964480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eef291-abd4-4688-b1bf-04b6dd35ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:05.965105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef291-abd4-4688-b1bf-04b6dd35ab9a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:05.965416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef291-abd4-4688-b1bf-04b6dd35ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:05.965690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef291-abd4-4688-b1bf-04b6dd35ab9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:05.966484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eef291-abd4-4688-b1bf-04b6dd35ab9a None admin] RBAC: Adding query filter params (role.id=ed22fd6ead7c4837a429f5150feb8fe3, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=577eab0ae167408086ce9260a4f237e3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:05.966796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eef291-abd4-4688-b1bf-04b6dd35ab9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:05.968280 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eef291-abd4-4688-b1bf-04b6dd35ab9a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:05.974071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 522/1045] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:05 2022] GET /identity/v3/role_assignments?user.id=577eab0ae167408086ce9260a4f237e3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=ed22fd6ead7c4837a429f5150feb8fe3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:06.184982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a438f-5aec-4cd5-ace5-dbbda504cd03 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:06.185365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a438f-5aec-4cd5-ace5-dbbda504cd03 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:06.185553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a438f-5aec-4cd5-ace5-dbbda504cd03 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:06.187091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 524/1046] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:06.192086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57460c-fbeb-4eef-bea2-798a0f393b17 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:06.192376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57460c-fbeb-4eef-bea2-798a0f393b17 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:06.192610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57460c-fbeb-4eef-bea2-798a0f393b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:06.211324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5a57460c-fbeb-4eef-bea2-798a0f393b17 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:06.212505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5a57460c-fbeb-4eef-bea2-798a0f393b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:06.291212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 523/1047] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:06.314079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a438f-5aec-4cd5-ace5-dbbda504cd03 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:06.406285 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:06.420423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a438f-5aec-4cd5-ace5-dbbda504cd03 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:06.458751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:06.459784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:06.460271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:06.460745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:06.472632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:06.478160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:06.479215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:06.480101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:06.482837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 525/1048] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:06.488711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57460c-fbeb-4eef-bea2-798a0f393b17 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:06.534828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:06.603537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57460c-fbeb-4eef-bea2-798a0f393b17 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:06.638425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:06.639058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:06.639338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:06.639611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:06.640330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:06.640635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:06.642051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:06.650657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 524/1049] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:06.656352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:06.761326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6451b-c542-401d-9483-a691be24b500 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:06.795466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:06.796163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:06.796449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:06.796783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] PATH_INFO: `/v3/users/c7496b009996482498ce74cafa8bd10e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:06.810134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] RBAC: Authorizing `identity:get_user(user_id=c7496b009996482498ce74cafa8bd10e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:06.811587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:06.813465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 526/1050] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:06 2022] GET /identity/v3/users/c7496b009996482498ce74cafa8bd10e => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:06.819282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:06.927401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:06.931313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910053-2ffe-4d1d-a5f5-4f9d51ff13c0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:06.966901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:06.967528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:06.967806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:06.968079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.036266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:07.037719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:07.134722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:07.141363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 525/1051] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:07.147857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:07.157582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:07.260943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15acf82-064a-46db-9626-cdc00c1c28e5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:07.296633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c8075-dbda-44c2-83d7-19b73c1b4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:07.297213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c8075-dbda-44c2-83d7-19b73c1b4081 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.297510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c8075-dbda-44c2-83d7-19b73c1b4081 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.297787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c8075-dbda-44c2-83d7-19b73c1b4081 None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.298933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c8075-dbda-44c2-83d7-19b73c1b4081 None admin] RBAC: Authorizing `identity:get_project(project_id=29e38b3d845d4613bb87b22b28d76191)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:07.300370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c8075-dbda-44c2-83d7-19b73c1b4081 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:07.302276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 527/1052] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:07 2022] GET /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:07.308430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:07.327845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66aef01-39ee-4bd2-9119-30e2eddacba7 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.328135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66aef01-39ee-4bd2-9119-30e2eddacba7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.328709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66aef01-39ee-4bd2-9119-30e2eddacba7 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.330233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 528/1053] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:20:07.335061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf48d9-f52d-4b60-9aaf-b256a4a03af4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.335318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf48d9-f52d-4b60-9aaf-b256a4a03af4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.335673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf48d9-f52d-4b60-9aaf-b256a4a03af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.354517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-99cf48d9-f52d-4b60-9aaf-b256a4a03af4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:07.355707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-99cf48d9-f52d-4b60-9aaf-b256a4a03af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:07.416953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e347668-8527-4477-ac27-027def77ae15 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:07.425927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 529/1054] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:07.448385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf48d9-f52d-4b60-9aaf-b256a4a03af4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:07.451499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:07.453642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:07.454471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.454938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.455353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.456291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=29e38b3d845d4613bb87b22b28d76191, user.id=c7496b009996482498ce74cafa8bd10e) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:07.456997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:07.458621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:07.472074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 526/1055] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:07 2022] GET /identity/v3/role_assignments?user.id=c7496b009996482498ce74cafa8bd10e&scope.project.id=29e38b3d845d4613bb87b22b28d76191&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:07.561408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf48d9-f52d-4b60-9aaf-b256a4a03af4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:07.599197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:07.599867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.600143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.600421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] PATH_INFO: `/v3/services/image` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.601068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:07.602503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:07.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:07.613423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:07.614407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 530/1056] 10.222.0.47 () {56 vars in 1105 bytes} [Fri Jul 29 08:20:07 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:07.623547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:07.688839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:07.729525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382129c6-8c26-403a-89ee-4a709331e2a0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:07.763360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f11e-8cdd-4511-a3be-09528017cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:07.763988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f11e-8cdd-4511-a3be-09528017cd76 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.764266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f11e-8cdd-4511-a3be-09528017cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.764538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f11e-8cdd-4511-a3be-09528017cd76 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.765215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f11e-8cdd-4511-a3be-09528017cd76 None admin] RBAC: Adding query filter params (name=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:07.765560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f11e-8cdd-4511-a3be-09528017cd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:07.766946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f11e-8cdd-4511-a3be-09528017cd76 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:07.773028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 527/1057] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:07.778113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:07.846227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:07.882020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfff7c-7385-435d-a734-d440203d8f64 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:07.918382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:07.919015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.919302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.919576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.920254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] RBAC: Adding query filter params (type=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:07.920557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:07.921963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:07.924089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d2939-c838-4129-84e0-5ec50235f0ff None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.924376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d2939-c838-4129-84e0-5ec50235f0ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.924652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d2939-c838-4129-84e0-5ec50235f0ff None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.926049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 528/1058] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:07.929676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 531/1059] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:07.931272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac1832-2cce-4803-832d-4a58981eadd6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:07.931559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac1832-2cce-4803-832d-4a58981eadd6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:07.931835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac1832-2cce-4803-832d-4a58981eadd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:07.935694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:07.951412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d8ac1832-2cce-4803-832d-4a58981eadd6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:07.952735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d8ac1832-2cce-4803-832d-4a58981eadd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:08.023750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 529/1060] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:08.039801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f7a07-808f-4f72-804d-f213a378d969 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:08.047184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac1832-2cce-4803-832d-4a58981eadd6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:08.073514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:08.079466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:08.080099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:08.080384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:08.080771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:08.081519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:08.082898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:08.107111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 532/1061] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:20:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:20:08.118193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:08.166406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac1832-2cce-4803-832d-4a58981eadd6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:08.211239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:08.211917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:08.212195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:08.212513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:08.224480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:08.229668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:08.230670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:08.238176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 530/1062] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Jul 29 08:20:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:08.240002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:08.350021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebf73f-e09e-4c26-9219-74127ace1036 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:08.383270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:08.383813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:08.384091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:08.384359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:08.385095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:08.385425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:08.386794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:08.395026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 533/1063] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Jul 29 08:20:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:08.400638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:08.499608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8085-7de5-4d18-8de8-b0feb357173d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:08.513682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:08.534832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d511110-986b-4537-a9e7-08004235725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:08.535534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d511110-986b-4537-a9e7-08004235725c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:08.535820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d511110-986b-4537-a9e7-08004235725c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:08.536090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d511110-986b-4537-a9e7-08004235725c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:08.546388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d511110-986b-4537-a9e7-08004235725c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:08.547871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d511110-986b-4537-a9e7-08004235725c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6d511110-986b-4537-a9e7-08004235725c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:08.563553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:08.564535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:08.565487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:20:08.565487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:08.565487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:08.565487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:08.565487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 531/1064] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:08.570783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:08.626585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:08.677375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e9a8f-e42c-4a98-bf3e-ac91a872af5f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:08.710308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:08.710924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:08.711206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:08.711479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:08.712172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:08.712477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:08.714252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:08.726664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 534/1065] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:08.732250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d511110-986b-4537-a9e7-08004235725c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:08.830705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d511110-986b-4537-a9e7-08004235725c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:08.864003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:08.864643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:08.864919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:08.865191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:08.872932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:08.874415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:20:08.885742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:08.886751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:20:08.887694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:08.888873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 532/1066] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:20:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:08.892663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:08.996621 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4127ee-0d7e-4613-9583-327de49cce8d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.008124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:09.032824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.033488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.033770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.034041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.034831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:09.035263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:09.036697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:09.058588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 535/1067] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:20:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:09.059918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.088916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:09.166151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b910a0-14e5-4f2d-8552-995232669817 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.200504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.201161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.201468 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.201743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.212640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:09.214547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:09.229792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:09.230762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:09.231690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:20:09.231690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:09.231690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:09.231690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:09.231690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 533/1068] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:09.241565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.346197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890e82b-d3fe-4aac-abde-1a36d82d9fe4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.381653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27eb2b-03ed-415c-a652-5c1750a2403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.382280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eb2b-03ed-415c-a652-5c1750a2403a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.382567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eb2b-03ed-415c-a652-5c1750a2403a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.382842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eb2b-03ed-415c-a652-5c1750a2403a None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.383565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27eb2b-03ed-415c-a652-5c1750a2403a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:09.383871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27eb2b-03ed-415c-a652-5c1750a2403a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:09.385311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27eb2b-03ed-415c-a652-5c1750a2403a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:09.397317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 536/1069] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:09.403165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.453118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8903f-d718-4b0e-b84a-a94ce994886e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.453488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8903f-d718-4b0e-b84a-a94ce994886e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.453710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8903f-d718-4b0e-b84a-a94ce994886e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.455059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 537/1070] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:20:09.459719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87694-5bce-4e49-a790-2b061037c7d2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.460004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87694-5bce-4e49-a790-2b061037c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.460278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87694-5bce-4e49-a790-2b061037c7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.478755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-13f87694-5bce-4e49-a790-2b061037c7d2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:09.480045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-13f87694-5bce-4e49-a790-2b061037c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:09.487176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:09.503779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:09.512485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7a926-bb60-435c-8087-7636122656a9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.550129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 538/1071] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:09.552128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.552781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.553055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.553349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.560562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:09.562092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:09.571713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f87694-5bce-4e49-a790-2b061037c7d2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:20:09.573514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:09.574377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:20:09.575289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:09.580622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 534/1072] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:09.582672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.673608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f87694-5bce-4e49-a790-2b061037c7d2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.685607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb337f89-7435-4133-b980-7340c15b2ce8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.709955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.710613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.710899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.711185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.721995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:09.722138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757990-be79-482b-b614-68734f82631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.722795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757990-be79-482b-b614-68734f82631c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.723076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757990-be79-482b-b614-68734f82631c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.723349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757990-be79-482b-b614-68734f82631c None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.724149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5757990-be79-482b-b614-68734f82631c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:09.724447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5757990-be79-482b-b614-68734f82631c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:09.725924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5757990-be79-482b-b614-68734f82631c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:09.726888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:09.727770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:09.728606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 539/1073] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:09.733980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.736163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:09.748432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 535/1074] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:09.749667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757990-be79-482b-b614-68734f82631c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.755376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:09.841081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483ca8-31b9-4356-b336-48bcb249f3c4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.860810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757990-be79-482b-b614-68734f82631c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:09.878934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.879851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.880279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.881108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.882295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:09.882770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:09.885066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:09.895113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:09.895599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 540/1075] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:09.896092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:09.896092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:09.896315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/577eab0ae167408086ce9260a4f237e3/roles/ed22fd6ead7c4837a429f5150feb8fe3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:09.898527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=577eab0ae167408086ce9260a4f237e3, role_id=ed22fd6ead7c4837a429f5150feb8fe3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:09.900008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:09.900970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:09.917430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 536/1076] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:20:09 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/577eab0ae167408086ce9260a4f237e3/roles/ed22fd6ead7c4837a429f5150feb8fe3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:20:09.995469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:10.019262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b526f-8ec4-4f69-81a3-6ff63448d0bd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:10.057571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792c3fa-82eb-4b01-9a12-29de44a85c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:10.058240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792c3fa-82eb-4b01-9a12-29de44a85c67 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.058532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792c3fa-82eb-4b01-9a12-29de44a85c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.058798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792c3fa-82eb-4b01-9a12-29de44a85c67 None admin] PATH_INFO: `/v3/users/c7496b009996482498ce74cafa8bd10e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.060054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792c3fa-82eb-4b01-9a12-29de44a85c67 None admin] RBAC: Authorizing `identity:get_user(user_id=c7496b009996482498ce74cafa8bd10e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:10.061605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792c3fa-82eb-4b01-9a12-29de44a85c67 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:10.068168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 541/1077] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:09 2022] GET /identity/v3/users/c7496b009996482498ce74cafa8bd10e => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:10.069501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:10.125437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899205-e494-41db-b704-fc4dab79b30f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.125798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899205-e494-41db-b704-fc4dab79b30f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.126026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899205-e494-41db-b704-fc4dab79b30f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.127528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 542/1078] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:20:10.132527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487754d9-24df-4d83-95f5-6a011626cce5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.132820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487754d9-24df-4d83-95f5-6a011626cce5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.133102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487754d9-24df-4d83-95f5-6a011626cce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.134065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:10.151860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-487754d9-24df-4d83-95f5-6a011626cce5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:10.153061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-487754d9-24df-4d83-95f5-6a011626cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:10.182311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e775a-b705-44fb-a970-b0e050579d0e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:10.217868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:10.218527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.218806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.219088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.220252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] RBAC: Authorizing `identity:get_project(project_id=29e38b3d845d4613bb87b22b28d76191)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:10.221757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:10.223847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 537/1079] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:10 2022] GET /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:10.227025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 543/1080] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:10.229631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:10.250282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487754d9-24df-4d83-95f5-6a011626cce5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:10.333194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:10.344240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b40b-ccbc-4b89-b155-cc7249cbb421 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:10.359612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487754d9-24df-4d83-95f5-6a011626cce5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:10.370981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:10.382462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:10.383249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.383531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.383859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191/users/c7496b009996482498ce74cafa8bd10e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.386347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=29e38b3d845d4613bb87b22b28d76191, user_id=c7496b009996482498ce74cafa8bd10e, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:10.388239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:10.396782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:10.397424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.397776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.398094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.403969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 538/1081] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:20:10 2022] PUT /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191/users/c7496b009996482498ce74cafa8bd10e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:20:10.485566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:10.487127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:10.572353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:10.595915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 544/1082] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 08:20:10.602054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:10.704533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afb051-76e6-4cbd-af97-975e105c7fe7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:10.739635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dfe0d-e0d6-4b1d-98f7-c447b42cf38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:10.740278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dfe0d-e0d6-4b1d-98f7-c447b42cf38c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.740548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dfe0d-e0d6-4b1d-98f7-c447b42cf38c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.740812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dfe0d-e0d6-4b1d-98f7-c447b42cf38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.750940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dfe0d-e0d6-4b1d-98f7-c447b42cf38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:10.752416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dfe0d-e0d6-4b1d-98f7-c447b42cf38c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f73dfe0d-e0d6-4b1d-98f7-c447b42cf38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:10.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:10.767796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:10.768725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:20:10.768725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:10.768725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:10.768725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:10.768725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 539/1083] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:10.774347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:10.878677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2af21-36fc-442b-a128-ef5a5adec04e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:10.913416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c6fc1-5bef-4e5f-9cd5-a7b9e3e063bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:10.914045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c6fc1-5bef-4e5f-9cd5-a7b9e3e063bf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:10.914308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c6fc1-5bef-4e5f-9cd5-a7b9e3e063bf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:10.914590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c6fc1-5bef-4e5f-9cd5-a7b9e3e063bf None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:10.915292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c6fc1-5bef-4e5f-9cd5-a7b9e3e063bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:10.915601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c6fc1-5bef-4e5f-9cd5-a7b9e3e063bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:10.917041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c6fc1-5bef-4e5f-9cd5-a7b9e3e063bf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:10.928708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 545/1084] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:11.910860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe43b7-44d1-4e0c-b463-205b42b1f899 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:11.911411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe43b7-44d1-4e0c-b463-205b42b1f899 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:11.911411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe43b7-44d1-4e0c-b463-205b42b1f899 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:11.912805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 540/1085] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:11.918238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b469ed1-d627-489a-8950-7e78558ef22a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:11.918646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b469ed1-d627-489a-8950-7e78558ef22a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:11.918800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b469ed1-d627-489a-8950-7e78558ef22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:11.938656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1b469ed1-d627-489a-8950-7e78558ef22a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:11.939858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1b469ed1-d627-489a-8950-7e78558ef22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:11.972720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.012319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 546/1086] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:12.035628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe43b7-44d1-4e0c-b463-205b42b1f899 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.079519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.141060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe43b7-44d1-4e0c-b463-205b42b1f899 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.173988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.174562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.174842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.175115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.186098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:12.190998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:12.191976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:12.193273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 541/1087] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:12.198438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b469ed1-d627-489a-8950-7e78558ef22a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.305268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b469ed1-d627-489a-8950-7e78558ef22a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.341237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacda31-9165-4a78-b12f-42163ab76585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.341886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacda31-9165-4a78-b12f-42163ab76585 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.342165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacda31-9165-4a78-b12f-42163ab76585 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.342443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacda31-9165-4a78-b12f-42163ab76585 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.343164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacda31-9165-4a78-b12f-42163ab76585 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:12.343467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacda31-9165-4a78-b12f-42163ab76585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:12.344834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacda31-9165-4a78-b12f-42163ab76585 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:12.353317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 547/1088] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:12.359294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.396804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2755-af80-4aff-89db-a255733d4174 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.397089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2755-af80-4aff-89db-a255733d4174 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.397398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2755-af80-4aff-89db-a255733d4174 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.398744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 548/1089] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:20:12.404517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e29ee-78be-4aa5-aaff-e89fd7b6235f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.404860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e29ee-78be-4aa5-aaff-e89fd7b6235f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.405255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e29ee-78be-4aa5-aaff-e89fd7b6235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.426275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-281e29ee-78be-4aa5-aaff-e89fd7b6235f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:12.427398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-281e29ee-78be-4aa5-aaff-e89fd7b6235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:12.451183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.464864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.468059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d489e5-6310-4343-b7e9-712fb2cb0553 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.499702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 549/1090] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:12.505672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.506393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.506744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.507092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.517556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:12.519124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:12.522684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e29ee-78be-4aa5-aaff-e89fd7b6235f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:12.533310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:12.534373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:12.535320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:20:12.535320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:12.535320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:12.535320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:12.535320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 542/1091] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:12.539966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.625385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e29ee-78be-4aa5-aaff-e89fd7b6235f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.641268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd7ce0-cffe-45db-b7a2-ee88e3d1fe7a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.660831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.661512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.661796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.662079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.672261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:12.675524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.676142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.676474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.676687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:12.677100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:12.678195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:12.679079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:12.679734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:12.679734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:12.679876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 550/1092] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:12.679947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:12.684509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.695322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 543/1093] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:12.696278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.706118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.708563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.783640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6664-fe40-4427-b3cf-6c4995bb4ace None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.792742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb95a-a9a7-462f-806e-bb75ef28a139 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.816138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.816755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.817034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.817330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.818046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:12.818348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:12.819710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:12.826319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.826965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.827243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.827512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.827818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 551/1094] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:12.833557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.835186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:12.836677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:20:12.849116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:12.850108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:12.851092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 544/1095] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:12.855909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.918811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.923109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:12.937800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1fd4-3d76-4705-a6f8-67679fb516e9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.954245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacde6e-da11-4abd-b489-85d0f150574a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:12.973135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.973853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.974106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.974400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] PATH_INFO: `/v3/users/c7496b009996482498ce74cafa8bd10e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.975668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] RBAC: Authorizing `identity:get_user(user_id=c7496b009996482498ce74cafa8bd10e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:12.977109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:12.978790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 552/1096] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/users/c7496b009996482498ce74cafa8bd10e => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:12.984446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:12.987618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:12.988239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:12.988516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:12.988787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:12.989606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:12.989909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:12.991337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.008581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 545/1097] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:13.014272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:13.089594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60c54e-92b5-44b9-b984-ed2fee82658e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.111917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875bb90-15df-4871-8b27-69dba79c3fb9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.123217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.123855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.124131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.124424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.138350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:13.144009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:13.146547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.147163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.147448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.147720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.192358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.193769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.217755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.219226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.295640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 553/1098] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:13.296876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:13.318498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 546/1099] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:13.324244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:13.346906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:13.351870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:13.401383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dacc2c-4b58-47a0-91ef-22f8078c48ce None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.423596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a49e4-876c-4aee-9789-95ff4d45b320 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.436390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.437050 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.437661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.437661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.438790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] RBAC: Authorizing `identity:get_project(project_id=29e38b3d845d4613bb87b22b28d76191)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.440220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.441908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 554/1100] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:13.448044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:13.457780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.458435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.458719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.458993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.469307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.470794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:13.485095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:13.486047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:13.487138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:20:13.487138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:13.487138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:20:13.487138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:13.487138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 547/1101] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:20:13.491818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:13.553200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5d912-12a5-48bd-bff9-f0adbaae4bce None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.573325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:13.577156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:13.594617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.595295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.595575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.595848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.596639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=29e38b3d845d4613bb87b22b28d76191, user.id=c7496b009996482498ce74cafa8bd10e) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:13.596946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.598393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.599399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e887f-9520-4b93-8439-29e30e3d542c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.604307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 555/1102] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/role_assignments?user.id=c7496b009996482498ce74cafa8bd10e&scope.project.id=29e38b3d845d4613bb87b22b28d76191&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:13.636283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.636918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.637194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.637498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.638205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:13.638506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.639927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.653146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 548/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:13.659309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:13.770071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841c48-3176-4934-8164-090cb4fd941f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.805318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.805973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.806276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.806557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.813474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.814928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:20:13.827120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:13.828202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:13.829321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 556/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:13.835856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:13.940161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79424b0a-8616-4b0e-8abd-f5da48b6d59c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:13.975529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274c0d-b88a-4c43-a052-12e4e4bd4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:13.976156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274c0d-b88a-4c43-a052-12e4e4bd4882 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:13.976431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274c0d-b88a-4c43-a052-12e4e4bd4882 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:13.976706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274c0d-b88a-4c43-a052-12e4e4bd4882 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:13.977488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274c0d-b88a-4c43-a052-12e4e4bd4882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:13.977792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274c0d-b88a-4c43-a052-12e4e4bd4882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:13.979267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274c0d-b88a-4c43-a052-12e4e4bd4882 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:13.988030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:13.991723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 549/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:13.998148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:14.040783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:14.099460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14abe-bdd7-437e-934e-ac540cff7041 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:14.135715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f0162-629a-47b8-acae-62b89c7a7a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:14.136334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f0162-629a-47b8-acae-62b89c7a7a4b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:14.136612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f0162-629a-47b8-acae-62b89c7a7a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:14.136885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f0162-629a-47b8-acae-62b89c7a7a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:14.137700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f0162-629a-47b8-acae-62b89c7a7a4b None admin] RBAC: Adding query filter params (role.id=ed22fd6ead7c4837a429f5150feb8fe3, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=577eab0ae167408086ce9260a4f237e3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:14.138008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f0162-629a-47b8-acae-62b89c7a7a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:14.139431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f0162-629a-47b8-acae-62b89c7a7a4b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:14.145178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 557/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:13 2022] GET /identity/v3/role_assignments?user.id=577eab0ae167408086ce9260a4f237e3&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=ed22fd6ead7c4837a429f5150feb8fe3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:15.616453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aabfd3-26dc-4207-9207-8f9f77b3fa37 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:15.617347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aabfd3-26dc-4207-9207-8f9f77b3fa37 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:15.617347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aabfd3-26dc-4207-9207-8f9f77b3fa37 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:15.619556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 550/1107] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:15.628283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5710-e5bd-4733-b556-2c82245f7fc1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:15.628992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5710-e5bd-4733-b556-2c82245f7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:15.629142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5710-e5bd-4733-b556-2c82245f7fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:15.651805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d34d5710-e5bd-4733-b556-2c82245f7fc1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:15.653086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d34d5710-e5bd-4733-b556-2c82245f7fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:15.745780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 558/1108] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:15.771343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aabfd3-26dc-4207-9207-8f9f77b3fa37 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:15.883572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aabfd3-26dc-4207-9207-8f9f77b3fa37 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:15.932422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac599c-6e41-44ad-9827-8b2e0eb47c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:15.933068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac599c-6e41-44ad-9827-8b2e0eb47c13 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:15.933375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac599c-6e41-44ad-9827-8b2e0eb47c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:15.933654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac599c-6e41-44ad-9827-8b2e0eb47c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:15.934867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac599c-6e41-44ad-9827-8b2e0eb47c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:15.936340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac599c-6e41-44ad-9827-8b2e0eb47c13 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:15.937934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 551/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:15.943881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5710-e5bd-4733-b556-2c82245f7fc1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:15.980741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:16.063533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5710-e5bd-4733-b556-2c82245f7fc1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:16.100002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287324d-7e52-4c2d-9252-0ad198b96c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:16.100895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287324d-7e52-4c2d-9252-0ad198b96c1d None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:16.101313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287324d-7e52-4c2d-9252-0ad198b96c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:16.101687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287324d-7e52-4c2d-9252-0ad198b96c1d None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:16.102727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287324d-7e52-4c2d-9252-0ad198b96c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:16.104587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287324d-7e52-4c2d-9252-0ad198b96c1d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:16.130942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 559/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:20:15 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:20:18.134438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb190a-6eca-4042-91ec-3ca39d1e1fe4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:18.135324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb190a-6eca-4042-91ec-3ca39d1e1fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:18.135324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb190a-6eca-4042-91ec-3ca39d1e1fe4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:18.137540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 552/1111] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:18.142973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c5490-1399-429f-8d32-d4e84bf0f7d8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:18.143389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c5490-1399-429f-8d32-d4e84bf0f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:18.143503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c5490-1399-429f-8d32-d4e84bf0f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:18.163956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e03c5490-1399-429f-8d32-d4e84bf0f7d8 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:18.165167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e03c5490-1399-429f-8d32-d4e84bf0f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:18.240994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 560/1112] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:18.265099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb190a-6eca-4042-91ec-3ca39d1e1fe4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:18.337330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:18.379385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb190a-6eca-4042-91ec-3ca39d1e1fe4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:18.418526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:18.419090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:18.419372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:18.419646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] PATH_INFO: `/v3/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:18.421228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] RBAC: Authorizing `identity:get_role(role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:18.422665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:18.424045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 553/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:18 2022] GET /identity/v3/roles/d8ac88c62f844b499ed53400465ff365 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:18.430349 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c5490-1399-429f-8d32-d4e84bf0f7d8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:18.456582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:18.536088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c5490-1399-429f-8d32-d4e84bf0f7d8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:18.571553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:18.572187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:18.572523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:18.572796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] PATH_INFO: `/v3/users/946d1b866a8144fbabc7cc2bcff9dfdf` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:18.586404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] RBAC: Authorizing `identity:get_user(user_id=946d1b866a8144fbabc7cc2bcff9dfdf)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:18.587872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:18.589854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 561/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:18 2022] GET /identity/v3/users/946d1b866a8144fbabc7cc2bcff9dfdf => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:18.596358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:18.712822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fdad8-3f49-4f71-9ec8-08f3722eefff None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:18.749445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:18.750065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:18.750344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:18.750619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:18.754426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:18.828225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:18.829733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:18.933534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 554/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:18.939744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:19.035854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:19.055442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f47b5c-1461-4a50-b2ee-3a1f798d99fd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:19.099584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772ff7-27cb-41ce-b4cb-7cd6a2a1f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:19.100235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772ff7-27cb-41ce-b4cb-7cd6a2a1f754 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:19.100522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772ff7-27cb-41ce-b4cb-7cd6a2a1f754 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:19.100801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772ff7-27cb-41ce-b4cb-7cd6a2a1f754 None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:19.102612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772ff7-27cb-41ce-b4cb-7cd6a2a1f754 None admin] RBAC: Authorizing `identity:get_project(project_id=29e38b3d845d4613bb87b22b28d76191)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:19.105113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772ff7-27cb-41ce-b4cb-7cd6a2a1f754 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:19.107818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 562/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:18 2022] GET /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:19.117947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:19.158446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:19.224914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320544-8e21-4719-a747-5dfd4f146c38 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:19.270300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41009-940d-4a04-9f71-879e801ec597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:19.270934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41009-940d-4a04-9f71-879e801ec597 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:19.271215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41009-940d-4a04-9f71-879e801ec597 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:19.271493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41009-940d-4a04-9f71-879e801ec597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:19.272297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41009-940d-4a04-9f71-879e801ec597 None admin] RBAC: Adding query filter params (role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=29e38b3d845d4613bb87b22b28d76191, user.id=946d1b866a8144fbabc7cc2bcff9dfdf) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:19.272609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41009-940d-4a04-9f71-879e801ec597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:19.274104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41009-940d-4a04-9f71-879e801ec597 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:19.279822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 555/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:19 2022] GET /identity/v3/role_assignments?user.id=946d1b866a8144fbabc7cc2bcff9dfdf&scope.project.id=29e38b3d845d4613bb87b22b28d76191&role.id=d8ac88c62f844b499ed53400465ff365 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:21.224564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c3d1-bc10-4884-acc6-04c1b95b50d6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:21.225653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c3d1-bc10-4884-acc6-04c1b95b50d6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:21.225653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c3d1-bc10-4884-acc6-04c1b95b50d6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:21.227669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 563/1118] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:21.233964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b9ef1-1743-4f92-89d6-7e563481df0c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:21.234692 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b9ef1-1743-4f92-89d6-7e563481df0c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:21.234796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b9ef1-1743-4f92-89d6-7e563481df0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:21.257946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-349b9ef1-1743-4f92-89d6-7e563481df0c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:21.259172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-349b9ef1-1743-4f92-89d6-7e563481df0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:21.328919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 556/1119] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:21.351493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c3d1-bc10-4884-acc6-04c1b95b50d6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:21.455038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c3d1-bc10-4884-acc6-04c1b95b50d6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:21.490127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:21.490698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:21.490981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:21.491261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] PATH_INFO: `/v3/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:21.492712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] RBAC: Authorizing `identity:get_role(role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:21.494138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:21.495460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 564/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:21 2022] GET /identity/v3/roles/d8ac88c62f844b499ed53400465ff365 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:21.501408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b9ef1-1743-4f92-89d6-7e563481df0c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:21.535155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:21.610965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b9ef1-1743-4f92-89d6-7e563481df0c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:21.646014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:21.646650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:21.646913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:21.647189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] PATH_INFO: `/v3/users/946d1b866a8144fbabc7cc2bcff9dfdf` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:21.648358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] RBAC: Authorizing `identity:get_user(user_id=946d1b866a8144fbabc7cc2bcff9dfdf)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:21.649852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:21.652352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 557/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:21 2022] GET /identity/v3/users/946d1b866a8144fbabc7cc2bcff9dfdf => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:21.661439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:21.687679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:21.778433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5096e9d-1263-40eb-94fc-9a496e26b918 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:21.822235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b0f6e-deae-40cb-afa4-5bc555d222c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:21.822878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b0f6e-deae-40cb-afa4-5bc555d222c5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:21.823163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b0f6e-deae-40cb-afa4-5bc555d222c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:21.823438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b0f6e-deae-40cb-afa4-5bc555d222c5 None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:21.824657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b0f6e-deae-40cb-afa4-5bc555d222c5 None admin] RBAC: Authorizing `identity:get_project(project_id=29e38b3d845d4613bb87b22b28d76191)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:21.826128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b0f6e-deae-40cb-afa4-5bc555d222c5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:21.827795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 565/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:21 2022] GET /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:21.834017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:21.939220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:21.943347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae0fc0-5743-49c9-af19-529bab484126 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:21.979145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6888db2-d1bb-443c-82b7-e8bae141ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:21.979961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6888db2-d1bb-443c-82b7-e8bae141ea65 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:21.980336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6888db2-d1bb-443c-82b7-e8bae141ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:21.980712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6888db2-d1bb-443c-82b7-e8bae141ea65 None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191/users/946d1b866a8144fbabc7cc2bcff9dfdf/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:21.983015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6888db2-d1bb-443c-82b7-e8bae141ea65 None admin] RBAC: Authorizing `identity:create_grant(project_id=29e38b3d845d4613bb87b22b28d76191, user_id=946d1b866a8144fbabc7cc2bcff9dfdf, role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:21.984596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6888db2-d1bb-443c-82b7-e8bae141ea65 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:22.000758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 558/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:20:21 2022] PUT /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191/users/946d1b866a8144fbabc7cc2bcff9dfdf/roles/d8ac88c62f844b499ed53400465ff365 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:20:23.938861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8de1b-4d66-4639-91d4-08c730533ce5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:23.939509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8de1b-4d66-4639-91d4-08c730533ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:23.939509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8de1b-4d66-4639-91d4-08c730533ce5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:23.940764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 566/1124] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:23.947066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d730cb-207a-426c-b9e6-989d074d7163 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:23.947779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d730cb-207a-426c-b9e6-989d074d7163 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:23.947930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d730cb-207a-426c-b9e6-989d074d7163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:23.973654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-54d730cb-207a-426c-b9e6-989d074d7163 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:23.974858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-54d730cb-207a-426c-b9e6-989d074d7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:24.046474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 559/1125] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:24.073305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8de1b-4d66-4639-91d4-08c730533ce5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:24.163509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:24.180709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8de1b-4d66-4639-91d4-08c730533ce5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:24.215902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:24.216479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:24.216757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:24.217031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] PATH_INFO: `/v3/roles/d8ac88c62f844b499ed53400465ff365` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:24.218612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] RBAC: Authorizing `identity:get_role(role_id=d8ac88c62f844b499ed53400465ff365)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:24.219988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:24.221303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 567/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:24 2022] GET /identity/v3/roles/d8ac88c62f844b499ed53400465ff365 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:24.230031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d730cb-207a-426c-b9e6-989d074d7163 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:24.323411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:24.337957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d730cb-207a-426c-b9e6-989d074d7163 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:24.372522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:24.373162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:24.373472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:24.373741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] PATH_INFO: `/v3/users/946d1b866a8144fbabc7cc2bcff9dfdf` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:24.374968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] RBAC: Authorizing `identity:get_user(user_id=946d1b866a8144fbabc7cc2bcff9dfdf)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:24.376416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:24.378055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 560/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:24 2022] GET /identity/v3/users/946d1b866a8144fbabc7cc2bcff9dfdf => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:24.384140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:24.487904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d7f46-a3df-4d59-8ab1-f28c576f04cc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:24.522905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:24.523514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:24.523800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:24.524081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:24.545778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:24.593840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:24.595280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:24.698809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 568/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:24.708185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:24.811927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd135af-0ce2-4f00-b0d5-b54b63351035 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:24.847848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7961a-6066-4d82-97c4-acfe7e3d8e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:24.848494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7961a-6066-4d82-97c4-acfe7e3d8e11 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:24.848775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7961a-6066-4d82-97c4-acfe7e3d8e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:24.849051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7961a-6066-4d82-97c4-acfe7e3d8e11 None admin] PATH_INFO: `/v3/projects/29e38b3d845d4613bb87b22b28d76191` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:24.850280 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7961a-6066-4d82-97c4-acfe7e3d8e11 None admin] RBAC: Authorizing `identity:get_project(project_id=29e38b3d845d4613bb87b22b28d76191)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:24.851728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7961a-6066-4d82-97c4-acfe7e3d8e11 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:24.853427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 561/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:24 2022] GET /identity/v3/projects/29e38b3d845d4613bb87b22b28d76191 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:24.859901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:24.916572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:24.967239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901b7d-9108-4d48-a586-ebf4a4fc6fab None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:25.006229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d0dd4-97f9-4fc8-9aa0-825cbb45c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:25.006872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0dd4-97f9-4fc8-9aa0-825cbb45c670 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:25.007155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0dd4-97f9-4fc8-9aa0-825cbb45c670 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:25.007445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0dd4-97f9-4fc8-9aa0-825cbb45c670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:25.008233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d0dd4-97f9-4fc8-9aa0-825cbb45c670 None admin] RBAC: Adding query filter params (role.id=d8ac88c62f844b499ed53400465ff365, scope.project.id=29e38b3d845d4613bb87b22b28d76191, user.id=946d1b866a8144fbabc7cc2bcff9dfdf) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:25.008550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d0dd4-97f9-4fc8-9aa0-825cbb45c670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:25.010070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d0dd4-97f9-4fc8-9aa0-825cbb45c670 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:25.015939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 569/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:24 2022] GET /identity/v3/role_assignments?user.id=946d1b866a8144fbabc7cc2bcff9dfdf&scope.project.id=29e38b3d845d4613bb87b22b28d76191&role.id=d8ac88c62f844b499ed53400465ff365 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:26.984674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee6b98-d1c0-4dc0-9e7a-0f4a74521c38 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:26.985585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee6b98-d1c0-4dc0-9e7a-0f4a74521c38 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:26.985585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee6b98-d1c0-4dc0-9e7a-0f4a74521c38 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:26.987747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 562/1131] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:26.994143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07756-95c7-4df8-ac20-f45a19a91f46 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:26.994576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07756-95c7-4df8-ac20-f45a19a91f46 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:26.994686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07756-95c7-4df8-ac20-f45a19a91f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:27.018749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c5c07756-95c7-4df8-ac20-f45a19a91f46 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:27.020711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c5c07756-95c7-4df8-ac20-f45a19a91f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:27.093678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 570/1132] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:27.128121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee6b98-d1c0-4dc0-9e7a-0f4a74521c38 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:27.165056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:27.246847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee6b98-d1c0-4dc0-9e7a-0f4a74521c38 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:27.281651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f178f7e-a5ad-4252-9390-ecabcd6cedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:27.282289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f178f7e-a5ad-4252-9390-ecabcd6cedfc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:27.282569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f178f7e-a5ad-4252-9390-ecabcd6cedfc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:27.282839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f178f7e-a5ad-4252-9390-ecabcd6cedfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:27.284058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f178f7e-a5ad-4252-9390-ecabcd6cedfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:27.285530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f178f7e-a5ad-4252-9390-ecabcd6cedfc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:27.287111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 563/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:27.294716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c07756-95c7-4df8-ac20-f45a19a91f46 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:27.346656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:27.403523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c07756-95c7-4df8-ac20-f45a19a91f46 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:27.439991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf315d-369d-42cb-91f2-ce4eee78ae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:27.440606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf315d-369d-42cb-91f2-ce4eee78ae4e None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:27.440889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf315d-369d-42cb-91f2-ce4eee78ae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:27.441165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf315d-369d-42cb-91f2-ce4eee78ae4e None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:27.441876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf315d-369d-42cb-91f2-ce4eee78ae4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:27.443314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf315d-369d-42cb-91f2-ce4eee78ae4e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:27.479054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 571/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:20:27 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:20:29.468666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6ff3-29a9-49c5-839b-be72d20baf4f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:29.469567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6ff3-29a9-49c5-839b-be72d20baf4f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:29.469567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6ff3-29a9-49c5-839b-be72d20baf4f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:29.471854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 564/1135] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:29.477366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a30e2-237c-4c46-8687-b89a9e807b2f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:29.477816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a30e2-237c-4c46-8687-b89a9e807b2f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:29.477909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a30e2-237c-4c46-8687-b89a9e807b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:29.498084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0b0a30e2-237c-4c46-8687-b89a9e807b2f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:29.499283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b0a30e2-237c-4c46-8687-b89a9e807b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:29.571756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 572/1136] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:29.595894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6ff3-29a9-49c5-839b-be72d20baf4f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:29.697661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:29.709795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6ff3-29a9-49c5-839b-be72d20baf4f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:29.745876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76917c2-82ae-40a0-b926-124d215fdc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:29.746512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76917c2-82ae-40a0-b926-124d215fdc13 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:29.746790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76917c2-82ae-40a0-b926-124d215fdc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:29.747063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76917c2-82ae-40a0-b926-124d215fdc13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:29.748319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76917c2-82ae-40a0-b926-124d215fdc13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:29.749803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76917c2-82ae-40a0-b926-124d215fdc13 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:29.751375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 565/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:20:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:29.757742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a30e2-237c-4c46-8687-b89a9e807b2f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:29.789013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:29.883217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a30e2-237c-4c46-8687-b89a9e807b2f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:29.918952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a873a-507c-4c09-8d6e-0d1ddfcec36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:29.919572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a873a-507c-4c09-8d6e-0d1ddfcec36a None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:29.919852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a873a-507c-4c09-8d6e-0d1ddfcec36a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:29.920131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a873a-507c-4c09-8d6e-0d1ddfcec36a None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:29.920838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a873a-507c-4c09-8d6e-0d1ddfcec36a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:29.922291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a873a-507c-4c09-8d6e-0d1ddfcec36a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:29.946755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 573/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:20:29 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:20:31.945676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e611-c0df-4cd6-80a2-3e076e05d470 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:31.946644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e611-c0df-4cd6-80a2-3e076e05d470 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:31.946644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e611-c0df-4cd6-80a2-3e076e05d470 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:31.950181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 566/1139] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:31.958373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6f55-63b9-43cb-bbb0-71d57d77f12d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:31.958844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6f55-63b9-43cb-bbb0-71d57d77f12d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:31.958934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6f55-63b9-43cb-bbb0-71d57d77f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:31.979138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-70fc6f55-63b9-43cb-bbb0-71d57d77f12d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:31.980319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-70fc6f55-63b9-43cb-bbb0-71d57d77f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:32.052886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 574/1140] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:32.083844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e611-c0df-4cd6-80a2-3e076e05d470 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:32.196380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e611-c0df-4cd6-80a2-3e076e05d470 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:32.231711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:32.232350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:32.232631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:32.232905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:32.244248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:32.249272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:32.250312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:32.251249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 567/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:32.256637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6f55-63b9-43cb-bbb0-71d57d77f12d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:32.273411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:32.367747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6f55-63b9-43cb-bbb0-71d57d77f12d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:32.405135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:32.405804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:32.406085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:32.406359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:32.407082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:32.407388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:32.408763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:32.416888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 575/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:32.425642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:32.450491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:32.534109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6734e8-2f57-421d-9015-ff7022109175 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:32.579932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:32.580559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:32.580834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:32.581103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] PATH_INFO: `/v3/users/66828fb805fc42759a89643801e1a361` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:32.596689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] RBAC: Authorizing `identity:get_user(user_id=66828fb805fc42759a89643801e1a361)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:32.599034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:32.600674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 568/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:32 2022] GET /identity/v3/users/66828fb805fc42759a89643801e1a361 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:32.608574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:32.701252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:32.725392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232248f-0ee8-468c-80b7-1f7ecfb1db3b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:32.761677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:32.762294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:32.762577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:32.762835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:32.832436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:32.833922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:32.913459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:32.945177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 576/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:32.951366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:33.034972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:33.066331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7c800-b08d-4bcc-a466-04d153e237f4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:33.102238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13aef2-4225-4eaf-9750-c50102d87e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:33.102872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13aef2-4225-4eaf-9750-c50102d87e80 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:33.103148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13aef2-4225-4eaf-9750-c50102d87e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:33.103421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13aef2-4225-4eaf-9750-c50102d87e80 None admin] PATH_INFO: `/v3/projects/1e47a93a91224ae9973897f869f45425` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:33.104683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13aef2-4225-4eaf-9750-c50102d87e80 None admin] RBAC: Authorizing `identity:get_project(project_id=1e47a93a91224ae9973897f869f45425)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:33.106884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13aef2-4225-4eaf-9750-c50102d87e80 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:33.108568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 569/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:32 2022] GET /identity/v3/projects/1e47a93a91224ae9973897f869f45425 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:33.118214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:33.239093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018275be-06ed-405e-9fd2-d363656ec251 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:33.278327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a7e3d-bc59-4ee2-a885-5e6c35293a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:33.278947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a7e3d-bc59-4ee2-a885-5e6c35293a3f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:33.279191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a7e3d-bc59-4ee2-a885-5e6c35293a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:33.279502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a7e3d-bc59-4ee2-a885-5e6c35293a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:33.280298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a7e3d-bc59-4ee2-a885-5e6c35293a3f None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=1e47a93a91224ae9973897f869f45425, user.id=66828fb805fc42759a89643801e1a361) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:33.280615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a7e3d-bc59-4ee2-a885-5e6c35293a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:33.282079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a7e3d-bc59-4ee2-a885-5e6c35293a3f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:33.287794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 577/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:33 2022] GET /identity/v3/role_assignments?user.id=66828fb805fc42759a89643801e1a361&scope.project.id=1e47a93a91224ae9973897f869f45425&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:35.245260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924661b-ac1c-45ee-aa59-9ab37a65dd77 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:35.245840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924661b-ac1c-45ee-aa59-9ab37a65dd77 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:35.245840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924661b-ac1c-45ee-aa59-9ab37a65dd77 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:35.247206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 570/1147] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:35.252700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c46bb-a71d-487c-b95e-d40e585811ba None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:35.253134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c46bb-a71d-487c-b95e-d40e585811ba None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:35.253236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c46bb-a71d-487c-b95e-d40e585811ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:35.272719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2e5c46bb-a71d-487c-b95e-d40e585811ba None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:35.273932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2e5c46bb-a71d-487c-b95e-d40e585811ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:35.308777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:35.344389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 578/1148] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:35.377222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924661b-ac1c-45ee-aa59-9ab37a65dd77 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:35.506138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924661b-ac1c-45ee-aa59-9ab37a65dd77 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:35.543661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:35.544302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:35.544580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:35.544855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:35.555273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:35.560197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:35.561257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:35.562401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 571/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:35.567476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c46bb-a71d-487c-b95e-d40e585811ba None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:35.670429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c46bb-a71d-487c-b95e-d40e585811ba None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:35.705358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:35.705980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:35.706253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:35.706527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:35.707245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:35.707555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:35.708926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:35.717643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 579/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:35.723452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:35.733728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:35.830889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0c55-7b61-4a93-bf72-12166c137501 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:35.867151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:35.867775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:35.868057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:35.868324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] PATH_INFO: `/v3/users/66828fb805fc42759a89643801e1a361` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:35.869684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] RBAC: Authorizing `identity:get_user(user_id=66828fb805fc42759a89643801e1a361)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:35.871122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:35.872711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 572/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:35 2022] GET /identity/v3/users/66828fb805fc42759a89643801e1a361 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:35.878801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:35.911149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:35.983214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b682a2-7b53-4001-a470-92fe911aba78 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:36.018369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f3b7-5498-4031-bece-0d73d31b22fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:36.018998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f3b7-5498-4031-bece-0d73d31b22fb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:36.019277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f3b7-5498-4031-bece-0d73d31b22fb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:36.019549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f3b7-5498-4031-bece-0d73d31b22fb None admin] PATH_INFO: `/v3/projects/1e47a93a91224ae9973897f869f45425` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:36.020819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f3b7-5498-4031-bece-0d73d31b22fb None admin] RBAC: Authorizing `identity:get_project(project_id=1e47a93a91224ae9973897f869f45425)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:36.022254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f3b7-5498-4031-bece-0d73d31b22fb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:36.023900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 580/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:35 2022] GET /identity/v3/projects/1e47a93a91224ae9973897f869f45425 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:36.030271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:36.105607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:36.131680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494938d-4ebb-4a3c-ba07-545aa4f80dbc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:36.166233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2698-b270-48e0-86ed-3f2f8b0a38e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:36.166911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2698-b270-48e0-86ed-3f2f8b0a38e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:36.167190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2698-b270-48e0-86ed-3f2f8b0a38e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:36.167458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2698-b270-48e0-86ed-3f2f8b0a38e1 None admin] PATH_INFO: `/v3/projects/1e47a93a91224ae9973897f869f45425/users/66828fb805fc42759a89643801e1a361/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:36.169524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd2698-b270-48e0-86ed-3f2f8b0a38e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e47a93a91224ae9973897f869f45425, user_id=66828fb805fc42759a89643801e1a361, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:36.170965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd2698-b270-48e0-86ed-3f2f8b0a38e1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:36.186897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 573/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:20:36 2022] PUT /identity/v3/projects/1e47a93a91224ae9973897f869f45425/users/66828fb805fc42759a89643801e1a361/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:20:38.145231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd19a2-5c3f-4c6a-8d2c-a7c0c1b3e400 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:38.146171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd19a2-5c3f-4c6a-8d2c-a7c0c1b3e400 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:38.146171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd19a2-5c3f-4c6a-8d2c-a7c0c1b3e400 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:38.148373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 581/1154] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:38.154745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45412f-2542-4e14-8c03-e0e499a7bd97 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:38.155203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45412f-2542-4e14-8c03-e0e499a7bd97 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:38.155309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45412f-2542-4e14-8c03-e0e499a7bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:38.184558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1f45412f-2542-4e14-8c03-e0e499a7bd97 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:38.185802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1f45412f-2542-4e14-8c03-e0e499a7bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:38.261997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 574/1155] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:38.285232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd19a2-5c3f-4c6a-8d2c-a7c0c1b3e400 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:38.391356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:38.396192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd19a2-5c3f-4c6a-8d2c-a7c0c1b3e400 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:38.435089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:38.435746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:38.436029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:38.436311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:38.447080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:38.452178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:38.453244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:38.454257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 582/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:38.460432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45412f-2542-4e14-8c03-e0e499a7bd97 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:38.535006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:38.581019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45412f-2542-4e14-8c03-e0e499a7bd97 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:38.617722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:38.618343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:38.618618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:38.618889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:38.619630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:38.619930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:38.621317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:38.630150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 575/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:38.636125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:38.744841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd773a6-cd14-4838-8750-2facc5d97d6e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:38.779780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:38.780407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:38.780693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:38.780970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] PATH_INFO: `/v3/users/66828fb805fc42759a89643801e1a361` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:38.782211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] RBAC: Authorizing `identity:get_user(user_id=66828fb805fc42759a89643801e1a361)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:38.783648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:38.785236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 583/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:38 2022] GET /identity/v3/users/66828fb805fc42759a89643801e1a361 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:38.791281 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:38.905799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227604c-2f50-42ef-a740-64d4daeacb24 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:38.934052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:38.943053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:38.943663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:38.943944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:38.944216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:39.016131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:39.017550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:39.115780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 576/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:39.125349 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:39.164479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:39.239897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff202bc6-d130-42ce-a056-aa1a86f926ce None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:39.278465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f5d93-5f21-4be6-9375-8b0deb782131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:39.279051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f5d93-5f21-4be6-9375-8b0deb782131 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:39.279336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f5d93-5f21-4be6-9375-8b0deb782131 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:39.279612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f5d93-5f21-4be6-9375-8b0deb782131 None admin] PATH_INFO: `/v3/projects/1e47a93a91224ae9973897f869f45425` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:39.280838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f5d93-5f21-4be6-9375-8b0deb782131 None admin] RBAC: Authorizing `identity:get_project(project_id=1e47a93a91224ae9973897f869f45425)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:39.282349 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f5d93-5f21-4be6-9375-8b0deb782131 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:39.284018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 584/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:39 2022] GET /identity/v3/projects/1e47a93a91224ae9973897f869f45425 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:39.290384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:39.318355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:39.405700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c1538-ca9d-448e-bfcd-0a9aa215c5d8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:39.441532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605846-8854-4138-88fe-afd3821b98d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:39.442142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605846-8854-4138-88fe-afd3821b98d6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:39.442417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605846-8854-4138-88fe-afd3821b98d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:39.442686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605846-8854-4138-88fe-afd3821b98d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:39.443464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56605846-8854-4138-88fe-afd3821b98d6 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=1e47a93a91224ae9973897f869f45425, user.id=66828fb805fc42759a89643801e1a361) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:39.443774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56605846-8854-4138-88fe-afd3821b98d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:39.445220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56605846-8854-4138-88fe-afd3821b98d6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:39.451623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 577/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:39 2022] GET /identity/v3/role_assignments?user.id=66828fb805fc42759a89643801e1a361&scope.project.id=1e47a93a91224ae9973897f869f45425&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:41.422085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209080f1-bf50-47a8-9c56-93781e5fccdc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:41.423382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209080f1-bf50-47a8-9c56-93781e5fccdc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:41.423611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209080f1-bf50-47a8-9c56-93781e5fccdc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:41.425936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 585/1162] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:41.434213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fcabd-e22f-4fb4-b7d2-3d42dd4e1d83 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:41.434672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fcabd-e22f-4fb4-b7d2-3d42dd4e1d83 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:41.435119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fcabd-e22f-4fb4-b7d2-3d42dd4e1d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:41.455482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8d8fcabd-e22f-4fb4-b7d2-3d42dd4e1d83 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:41.456691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8d8fcabd-e22f-4fb4-b7d2-3d42dd4e1d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:41.542507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 578/1163] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:41.576155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209080f1-bf50-47a8-9c56-93781e5fccdc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:41.678562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:41.685811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209080f1-bf50-47a8-9c56-93781e5fccdc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:41.732813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:41.733462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:41.733748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:41.734027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:41.804459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:41.805886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:41.900253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:41.912120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 586/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:41.922163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fcabd-e22f-4fb4-b7d2-3d42dd4e1d83 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:41.947637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:42.027909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fcabd-e22f-4fb4-b7d2-3d42dd4e1d83 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:42.062788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65897-d20d-4604-929c-f80ef4b656a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:42.063365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65897-d20d-4604-929c-f80ef4b656a2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:42.063647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65897-d20d-4604-929c-f80ef4b656a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:42.063916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65897-d20d-4604-929c-f80ef4b656a2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:42.070933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65897-d20d-4604-929c-f80ef4b656a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:42.072420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65897-d20d-4604-929c-f80ef4b656a2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a2f65897-d20d-4604-929c-f80ef4b656a2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:42.084172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:42.085310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:42.086536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 579/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:20:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:42.091908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:42.199300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e524-364b-4f9c-950d-337afe106e62 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:42.241350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9191cf6-f2d8-4907-bbaa-c57b030d5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:42.242249 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191cf6-f2d8-4907-bbaa-c57b030d5d4e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:42.242617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191cf6-f2d8-4907-bbaa-c57b030d5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:42.242963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191cf6-f2d8-4907-bbaa-c57b030d5d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:42.243980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191cf6-f2d8-4907-bbaa-c57b030d5d4e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:42.244399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191cf6-f2d8-4907-bbaa-c57b030d5d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:42.245807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191cf6-f2d8-4907-bbaa-c57b030d5d4e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:42.253705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 587/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Jul 29 08:20:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:44.200216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2142-e7c5-44e0-b06d-0e30d85fb2c5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:44.201134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2142-e7c5-44e0-b06d-0e30d85fb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:44.201134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2142-e7c5-44e0-b06d-0e30d85fb2c5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:44.203417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 580/1167] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:44.208802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c84e-1252-4d1d-93f6-88bc498654b7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:44.209219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c84e-1252-4d1d-93f6-88bc498654b7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:44.209347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c84e-1252-4d1d-93f6-88bc498654b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:44.235832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-18d0c84e-1252-4d1d-93f6-88bc498654b7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:44.237038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-18d0c84e-1252-4d1d-93f6-88bc498654b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:44.296224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:44.308051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 588/1168] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:44.330460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2142-e7c5-44e0-b06d-0e30d85fb2c5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:44.424559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:44.447554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2142-e7c5-44e0-b06d-0e30d85fb2c5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:44.482722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb91d-2e94-46cb-9744-6ab102666056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:44.483265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb91d-2e94-46cb-9744-6ab102666056 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:44.483546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb91d-2e94-46cb-9744-6ab102666056 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:44.483816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb91d-2e94-46cb-9744-6ab102666056 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:44.484511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb91d-2e94-46cb-9744-6ab102666056 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:44.485922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb91d-2e94-46cb-9744-6ab102666056 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:44.504193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 581/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Fri Jul 29 08:20:44 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:20:46.490001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d0d2-1a82-4a4c-a850-06989e5c337f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:46.490999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d0d2-1a82-4a4c-a850-06989e5c337f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:46.490999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d0d2-1a82-4a4c-a850-06989e5c337f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:46.493029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 589/1170] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:46.500229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ae03-dbee-432d-b158-da9ea9527d8c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:46.500690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ae03-dbee-432d-b158-da9ea9527d8c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:46.500786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ae03-dbee-432d-b158-da9ea9527d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:46.529010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bf84ae03-dbee-432d-b158-da9ea9527d8c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:46.530189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bf84ae03-dbee-432d-b158-da9ea9527d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:46.598385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 582/1171] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:46.630067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33d0d2-1a82-4a4c-a850-06989e5c337f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:46.740725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33d0d2-1a82-4a4c-a850-06989e5c337f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:46.775815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad786ec-c40f-4292-9a3f-9f080edea738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:46.776447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad786ec-c40f-4292-9a3f-9f080edea738 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:46.776730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad786ec-c40f-4292-9a3f-9f080edea738 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:46.777016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad786ec-c40f-4292-9a3f-9f080edea738 None admin] PATH_INFO: `/v3/domains/c2e34d478dd54a4d8412b12d27f45a9e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:46.787742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad786ec-c40f-4292-9a3f-9f080edea738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c2e34d478dd54a4d8412b12d27f45a9e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:46.789139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad786ec-c40f-4292-9a3f-9f080edea738 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:46.790773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 590/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Fri Jul 29 08:20:46 2022] GET /identity/v3/domains/c2e34d478dd54a4d8412b12d27f45a9e => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:46.800237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ae03-dbee-432d-b158-da9ea9527d8c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:46.887891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:46.920581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ae03-dbee-432d-b158-da9ea9527d8c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:46.958541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d267-f73d-4ac3-9b4a-a6fbecdea4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:46.959152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d267-f73d-4ac3-9b4a-a6fbecdea4be None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:46.959430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d267-f73d-4ac3-9b4a-a6fbecdea4be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:46.959688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d267-f73d-4ac3-9b4a-a6fbecdea4be None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:46.960369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408d267-f73d-4ac3-9b4a-a6fbecdea4be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:46.961849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408d267-f73d-4ac3-9b4a-a6fbecdea4be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:46.996766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 583/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:20:46 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:20:49.002777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620c8bf-4837-4293-89b3-36483dba6a12 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:49.003870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620c8bf-4837-4293-89b3-36483dba6a12 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:49.003870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620c8bf-4837-4293-89b3-36483dba6a12 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:49.005902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 591/1174] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:49.013055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fca4f7-7b77-4ce2-af0c-203f7a969a65 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:49.013659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fca4f7-7b77-4ce2-af0c-203f7a969a65 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:49.013659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fca4f7-7b77-4ce2-af0c-203f7a969a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:49.032157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d7fca4f7-7b77-4ce2-af0c-203f7a969a65 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:49.033393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d7fca4f7-7b77-4ce2-af0c-203f7a969a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:49.107071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 584/1175] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:49.131687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620c8bf-4837-4293-89b3-36483dba6a12 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:49.186473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:49.246034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620c8bf-4837-4293-89b3-36483dba6a12 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:49.286106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86329ec-e84b-442b-a35e-27c834fd58ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:49.286758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86329ec-e84b-442b-a35e-27c834fd58ea None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:49.287043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86329ec-e84b-442b-a35e-27c834fd58ea None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:49.287319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86329ec-e84b-442b-a35e-27c834fd58ea None admin] PATH_INFO: `/v3/domains/c2e34d478dd54a4d8412b12d27f45a9e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:49.288529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86329ec-e84b-442b-a35e-27c834fd58ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=c2e34d478dd54a4d8412b12d27f45a9e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:49.290031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86329ec-e84b-442b-a35e-27c834fd58ea None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:49.291700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 592/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Fri Jul 29 08:20:49 2022] GET /identity/v3/domains/c2e34d478dd54a4d8412b12d27f45a9e => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:49.300810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fca4f7-7b77-4ce2-af0c-203f7a969a65 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:49.359885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:49.411511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fca4f7-7b77-4ce2-af0c-203f7a969a65 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:49.446234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8f267-378b-403e-be5a-6e687e125b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:49.446852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f267-378b-403e-be5a-6e687e125b4f None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:49.447132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f267-378b-403e-be5a-6e687e125b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:49.447407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f267-378b-403e-be5a-6e687e125b4f None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:49.448093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8f267-378b-403e-be5a-6e687e125b4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:49.449574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8f267-378b-403e-be5a-6e687e125b4f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:49.473044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 585/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:20:49 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:20:51.484370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5357a0a-c110-44db-a634-d137fffe680e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:51.485261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5357a0a-c110-44db-a634-d137fffe680e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:51.485412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5357a0a-c110-44db-a634-d137fffe680e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:51.488904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 593/1178] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:51.495367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398348f8-dee8-439e-a481-4255b44f7e32 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:51.495819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398348f8-dee8-439e-a481-4255b44f7e32 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:51.495919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398348f8-dee8-439e-a481-4255b44f7e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:51.520665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-398348f8-dee8-439e-a481-4255b44f7e32 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:51.521843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-398348f8-dee8-439e-a481-4255b44f7e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:51.598733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 586/1179] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:51.623557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5357a0a-c110-44db-a634-d137fffe680e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:51.731655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5357a0a-c110-44db-a634-d137fffe680e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:51.749394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:51.769118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:51.769787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:51.770065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:51.770342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:51.781305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:51.786129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:51.787234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:51.788473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 594/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:51.793513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398348f8-dee8-439e-a481-4255b44f7e32 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:51.839713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:51.906315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398348f8-dee8-439e-a481-4255b44f7e32 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:51.946068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:51.946951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:51.947310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:51.947667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:51.948758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:51.949163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:51.951349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:51.964440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 587/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:51.971056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:52.107712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16557d3c-cfe4-4382-8bd5-e2c1fce8e971 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:52.150749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:52.152203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:52.152668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:52.153095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] PATH_INFO: `/v3/users/9fdd08e87f0f4575b56796e3261f3ec3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:52.172170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] RBAC: Authorizing `identity:get_user(user_id=9fdd08e87f0f4575b56796e3261f3ec3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:52.173661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:52.175321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 595/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:51 2022] GET /identity/v3/users/9fdd08e87f0f4575b56796e3261f3ec3 => generated 311 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:52.181578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:52.297110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:52.300503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ada5-2ce7-4c4d-97fa-58088aedeae2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:52.341325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:52.342250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:52.342525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:52.342793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:52.412416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:52.413834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:52.509078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:52.513051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 588/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:52.522218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:52.562086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:52.638101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b088-4e08-458c-9cf1-c17893b4f4ef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:52.688467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e6fe4-aaa5-4986-8c99-dcfbf6470fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:52.689029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6fe4-aaa5-4986-8c99-dcfbf6470fde None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:52.689325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6fe4-aaa5-4986-8c99-dcfbf6470fde None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:52.689609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6fe4-aaa5-4986-8c99-dcfbf6470fde None admin] PATH_INFO: `/v3/projects/7837343a998e4cf48a742bd7436d2a82` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:52.690909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e6fe4-aaa5-4986-8c99-dcfbf6470fde None admin] RBAC: Authorizing `identity:get_project(project_id=7837343a998e4cf48a742bd7436d2a82)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:52.692348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e6fe4-aaa5-4986-8c99-dcfbf6470fde None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:52.694061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 596/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:52 2022] GET /identity/v3/projects/7837343a998e4cf48a742bd7436d2a82 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:52.702305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:52.805062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a3a9-1af6-4ce1-af18-426540118529 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:52.840442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab33bc-76b8-49b0-987c-931769be83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:52.841050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab33bc-76b8-49b0-987c-931769be83c4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:52.841326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab33bc-76b8-49b0-987c-931769be83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:52.841619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab33bc-76b8-49b0-987c-931769be83c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:52.842403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab33bc-76b8-49b0-987c-931769be83c4 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=7837343a998e4cf48a742bd7436d2a82, user.id=9fdd08e87f0f4575b56796e3261f3ec3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:52.842707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab33bc-76b8-49b0-987c-931769be83c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:52.844144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab33bc-76b8-49b0-987c-931769be83c4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:52.849796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 589/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:52 2022] GET /identity/v3/role_assignments?user.id=9fdd08e87f0f4575b56796e3261f3ec3&scope.project.id=7837343a998e4cf48a742bd7436d2a82&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:54.774612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067833b6-5ad2-4abb-ac89-dedd9ee88080 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:54.775226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067833b6-5ad2-4abb-ac89-dedd9ee88080 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:54.775226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067833b6-5ad2-4abb-ac89-dedd9ee88080 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:54.776568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 597/1186] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:54.782933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6cf2-d448-4c15-99a8-b9a5e25de6bb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:54.783385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6cf2-d448-4c15-99a8-b9a5e25de6bb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:54.783490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6cf2-d448-4c15-99a8-b9a5e25de6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:54.811266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c31b6cf2-d448-4c15-99a8-b9a5e25de6bb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:54.812454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c31b6cf2-d448-4c15-99a8-b9a5e25de6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:54.875048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:54.888181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 590/1187] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:20:54.914883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067833b6-5ad2-4abb-ac89-dedd9ee88080 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:55.020205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067833b6-5ad2-4abb-ac89-dedd9ee88080 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:55.023916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:55.057974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:55.058545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:55.058833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:55.059111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:55.069501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:55.074510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:55.075522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:20:55.076393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 598/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:55.084644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6cf2-d448-4c15-99a8-b9a5e25de6bb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:55.194417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6cf2-d448-4c15-99a8-b9a5e25de6bb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:55.231126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:55.231731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:55.232015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:55.232284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:55.232978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:55.233316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:55.234704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:55.243408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 591/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:55.249384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:55.365965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855e1d4-6d04-4194-8fd7-0a6fc6e855c9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:55.401202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:55.401864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:55.402144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:55.402415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] PATH_INFO: `/v3/users/9fdd08e87f0f4575b56796e3261f3ec3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:55.403698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] RBAC: Authorizing `identity:get_user(user_id=9fdd08e87f0f4575b56796e3261f3ec3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:55.405128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:55.406757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 599/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:55 2022] GET /identity/v3/users/9fdd08e87f0f4575b56796e3261f3ec3 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:55.412766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:55.469964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:55.515241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f599561-7d0c-488d-8782-4cdaf6b98de9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:55.562998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0940f1f-dce8-4e6c-8670-8dc008616069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:55.563642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0940f1f-dce8-4e6c-8670-8dc008616069 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:55.563925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0940f1f-dce8-4e6c-8670-8dc008616069 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:55.564203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0940f1f-dce8-4e6c-8670-8dc008616069 None admin] PATH_INFO: `/v3/projects/7837343a998e4cf48a742bd7436d2a82` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:55.565461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0940f1f-dce8-4e6c-8670-8dc008616069 None admin] RBAC: Authorizing `identity:get_project(project_id=7837343a998e4cf48a742bd7436d2a82)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:55.566922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0940f1f-dce8-4e6c-8670-8dc008616069 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:55.568605 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 592/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:55 2022] GET /identity/v3/projects/7837343a998e4cf48a742bd7436d2a82 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:55.577799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:55.610553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:55.680137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de458fb7-ee92-4dea-bea7-01ff6a605e63 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:55.715583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d4077-f73f-4052-8f62-7414cdf1f06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:55.716246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4077-f73f-4052-8f62-7414cdf1f06f None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:55.716525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4077-f73f-4052-8f62-7414cdf1f06f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:55.716802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4077-f73f-4052-8f62-7414cdf1f06f None admin] PATH_INFO: `/v3/projects/7837343a998e4cf48a742bd7436d2a82/users/9fdd08e87f0f4575b56796e3261f3ec3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:55.719037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d4077-f73f-4052-8f62-7414cdf1f06f None admin] RBAC: Authorizing `identity:create_grant(project_id=7837343a998e4cf48a742bd7436d2a82, user_id=9fdd08e87f0f4575b56796e3261f3ec3, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:55.720469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d4077-f73f-4052-8f62-7414cdf1f06f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:55.736195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 600/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:20:55 2022] PUT /identity/v3/projects/7837343a998e4cf48a742bd7436d2a82/users/9fdd08e87f0f4575b56796e3261f3ec3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:20:57.674407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b448-f827-4565-a233-a6c9de404566 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:57.675292 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b448-f827-4565-a233-a6c9de404566 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:57.675292 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b448-f827-4565-a233-a6c9de404566 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:57.677506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 593/1193] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:20:57.685085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8d46-80b1-4b29-9fc0-01476ab21405 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:57.685550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8d46-80b1-4b29-9fc0-01476ab21405 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:57.685659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8d46-80b1-4b29-9fc0-01476ab21405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:57.705665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5a0f8d46-80b1-4b29-9fc0-01476ab21405 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:20:57.706844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a0f8d46-80b1-4b29-9fc0-01476ab21405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:20:57.781121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 601/1194] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:20:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:20:57.804218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b448-f827-4565-a233-a6c9de404566 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:57.913115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b448-f827-4565-a233-a6c9de404566 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:57.944270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:57.963666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:57.964377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:57.964658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:57.964930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:57.977600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:20:57.982498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:20:57.983562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:20:57.990362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 594/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:20:57.992274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8d46-80b1-4b29-9fc0-01476ab21405 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:58.025193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:58.112641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8d46-80b1-4b29-9fc0-01476ab21405 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:58.154366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:58.155293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:58.155688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:58.156094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:58.157189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:58.157636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:58.159798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:58.171988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 602/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:20:58.178122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:58.283808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8ad0-7b60-4e6f-aed4-5ddc1e5c38f5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:58.318916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:58.319554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:58.319834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:58.320122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] PATH_INFO: `/v3/users/9fdd08e87f0f4575b56796e3261f3ec3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:58.321416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] RBAC: Authorizing `identity:get_user(user_id=9fdd08e87f0f4575b56796e3261f3ec3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:58.322855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:58.324457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 595/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Jul 29 08:20:58 2022] GET /identity/v3/users/9fdd08e87f0f4575b56796e3261f3ec3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:58.331096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:58.427180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:58.443769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cb1bf-6dc1-4d28-81c3-e9b446d330fb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:58.478862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:58.479469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:58.479732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:58.480005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:58.551590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:58.552986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:58.637659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:58.655618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 603/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:20:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:20:58.661750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:58.715829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:20:58.765902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e90f8-2026-4c1a-a7c6-e1e5d3d6eee6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:58.800709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e059b-affe-43e0-8d5e-c5a2fc892887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:58.801368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e059b-affe-43e0-8d5e-c5a2fc892887 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:58.801701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e059b-affe-43e0-8d5e-c5a2fc892887 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:58.801910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e059b-affe-43e0-8d5e-c5a2fc892887 None admin] PATH_INFO: `/v3/projects/7837343a998e4cf48a742bd7436d2a82` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:58.803111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e059b-affe-43e0-8d5e-c5a2fc892887 None admin] RBAC: Authorizing `identity:get_project(project_id=7837343a998e4cf48a742bd7436d2a82)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:58.804547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e059b-affe-43e0-8d5e-c5a2fc892887 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:58.806213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 596/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Jul 29 08:20:58 2022] GET /identity/v3/projects/7837343a998e4cf48a742bd7436d2a82 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:20:58.815940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:20:58.925998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2685-733c-44f0-942d-eb0c7c66d763 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:20:58.961821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a3dc4-17fc-444d-8984-57069565be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:20:58.962779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a3dc4-17fc-444d-8984-57069565be9f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:20:58.963057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a3dc4-17fc-444d-8984-57069565be9f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:20:58.963341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a3dc4-17fc-444d-8984-57069565be9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:20:58.964127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a3dc4-17fc-444d-8984-57069565be9f None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=7837343a998e4cf48a742bd7436d2a82, user.id=9fdd08e87f0f4575b56796e3261f3ec3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:20:58.964446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a3dc4-17fc-444d-8984-57069565be9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:20:58.965932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a3dc4-17fc-444d-8984-57069565be9f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:20:58.972321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 604/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:20:58 2022] GET /identity/v3/role_assignments?user.id=9fdd08e87f0f4575b56796e3261f3ec3&scope.project.id=7837343a998e4cf48a742bd7436d2a82&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:21:08.796341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=40 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:08.969263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=76 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:54.070833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c8f4-1ffe-4e5b-b1ec-75df49c64d75 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:54.071486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c8f4-1ffe-4e5b-b1ec-75df49c64d75 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:54.071486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c8f4-1ffe-4e5b-b1ec-75df49c64d75 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:54.073104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 597/1201] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:21:54.078699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801a7c-963b-4982-8c13-b86160500b5c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:54.079226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801a7c-963b-4982-8c13-b86160500b5c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:54.079226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801a7c-963b-4982-8c13-b86160500b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:54.100833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8a801a7c-963b-4982-8c13-b86160500b5c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:21:54.102516 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8a801a7c-963b-4982-8c13-b86160500b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:21:54.200895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 605/1202] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:21:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:21:54.229828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c8f4-1ffe-4e5b-b1ec-75df49c64d75 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:54.372736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c8f4-1ffe-4e5b-b1ec-75df49c64d75 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:54.413868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:54.414568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:54.414855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:54.415137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:54.429811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:54.431300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:21:54.450757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:21:54.451888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:21:54.453007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:21:54.453007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:21:54.453007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:21:54.453007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:21:54.461508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 598/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:21:54.461826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a801a7c-963b-4982-8c13-b86160500b5c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:54.586385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a801a7c-963b-4982-8c13-b86160500b5c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:54.621520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:54.627967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8091c-07be-4187-950e-79b0f251c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:54.628651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8091c-07be-4187-950e-79b0f251c2cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:54.628920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8091c-07be-4187-950e-79b0f251c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:54.629428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8091c-07be-4187-950e-79b0f251c2cd None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:54.630361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8091c-07be-4187-950e-79b0f251c2cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:21:54.630734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8091c-07be-4187-950e-79b0f251c2cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:54.632187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8091c-07be-4187-950e-79b0f251c2cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:54.645605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 606/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:21:54.651542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:54.723022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:54.786661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21732168-6123-4d91-a1c2-7073465cd567 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:54.829112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b61a1-7290-4bd7-a5bf-7b767253ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:54.829850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b61a1-7290-4bd7-a5bf-7b767253ae72 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:54.830181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b61a1-7290-4bd7-a5bf-7b767253ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:54.830461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b61a1-7290-4bd7-a5bf-7b767253ae72 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:54.831262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b61a1-7290-4bd7-a5bf-7b767253ae72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:54.832772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b61a1-7290-4bd7-a5bf-7b767253ae72 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:54.869327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 599/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Jul 29 08:21:54 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:21:57.017345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d838a6-8a8e-4f7b-b688-405954fe59e4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:57.017985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d838a6-8a8e-4f7b-b688-405954fe59e4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:57.017985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d838a6-8a8e-4f7b-b688-405954fe59e4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:57.019481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 607/1206] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:21:57.025458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefcdfa-e5f5-4855-81bf-ebad42f1e397 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:57.025918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefcdfa-e5f5-4855-81bf-ebad42f1e397 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:57.026073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefcdfa-e5f5-4855-81bf-ebad42f1e397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:57.046821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8cefcdfa-e5f5-4855-81bf-ebad42f1e397 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:21:57.048349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8cefcdfa-e5f5-4855-81bf-ebad42f1e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:21:57.131190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 600/1207] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:21:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:21:57.152124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d838a6-8a8e-4f7b-b688-405954fe59e4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:57.281212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d838a6-8a8e-4f7b-b688-405954fe59e4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:57.319762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:57.320432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:57.320737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:57.321018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:57.331864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:21:57.337739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:21:57.339032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:21:57.339896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 608/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:21:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:21:57.345737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefcdfa-e5f5-4855-81bf-ebad42f1e397 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:57.391073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:57.461982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefcdfa-e5f5-4855-81bf-ebad42f1e397 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:57.513371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:57.514053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:57.514352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:57.514625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:57.515442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:21:57.515732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:57.517215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:57.529457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 601/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:21:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:21:57.532981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:57.591366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:57.650790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe7e6a-6e5c-443a-8746-1374ac8a0807 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:57.687572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:57.688218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:57.688512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:57.688792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:57.702214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:57.703573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:21:57.721917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:21:57.722945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:21:57.726425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:21:57.726425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:21:57.726425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:21:57.726425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:21:57.726425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 609/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:21:57.729176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:57.841681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:57.844913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e148-b8fa-46a8-bf8c-34ecd10faafb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:57.880489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:57.881382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:57.881795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:57.882119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:57.882945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:21:57.883670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:57.886342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:57.905318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 602/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:21:57.908078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:58.050336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9a0c3-8611-450c-9828-ca7a54982d2a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:58.052742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:58.101356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:58.102362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:58.102738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:58.103016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:58.116041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:58.117997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:21:58.133861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:21:58.135016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:21:58.136149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 610/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:21:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:21:58.142682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:58.252091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a898f3b-7668-4a40-a0c0-14fdb59a76ab None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:58.291956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:58.292650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:58.292881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:58.293158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:58.294059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:21:58.294352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:58.295787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:58.318973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 603/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Jul 29 08:21:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:21:58.320469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:58.442826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5383d2-8f3a-4e38-bf95-bd0f2f5ea71f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:58.479565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:58.480399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:58.480697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:58.480961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:58.513170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:58.555694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:58.557261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:58.663768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 611/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:21:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:21:58.669722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:58.689206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:58.786419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0ef5b-445b-4916-a1fe-0a24910d8536 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:58.836195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:58.837048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:58.837265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:58.837542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:58.849217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:58.850734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:21:58.867566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:21:58.868549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:21:58.869680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:21:58.869680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:21:58.869680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:21:58.869680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:21:58.869680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 604/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:21:58.874874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:58.943618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:58.986899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700aad-e52d-49b1-bfb8-afc8078c5cce None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:59.029830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:59.030488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:59.030761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:59.031035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:59.031735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:21:59.032036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:59.033481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:59.045938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 612/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:21:59.051852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:59.142066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:59.184337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb1c8d-fe40-4cbf-ad46-cf30e2a31ca3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:59.226104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:59.226904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:59.227185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:59.227553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:59.237765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:59.237765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:21:59.251383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:21:59.252579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:21:59.253713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:21:59.258030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 605/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:21:59.261098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:59.383571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44f72-8b39-4a86-bada-e8c9badf6b4c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:59.415147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:59.427925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3d68-005d-4e9e-80c9-69f25cdc2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:59.428555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3d68-005d-4e9e-80c9-69f25cdc2a92 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:59.428836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3d68-005d-4e9e-80c9-69f25cdc2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:59.429109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3d68-005d-4e9e-80c9-69f25cdc2a92 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:59.429892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c3d68-005d-4e9e-80c9-69f25cdc2a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:21:59.430226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c3d68-005d-4e9e-80c9-69f25cdc2a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:59.431663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c3d68-005d-4e9e-80c9-69f25cdc2a92 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:59.445815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 613/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:21:59.452002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:21:59.565757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe67352-93d2-4ef3-b43c-81cdc4e90672 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:21:59.597244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:21:59.604381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c53cf-cba2-461d-958f-c1f2f5546072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:21:59.605110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c53cf-cba2-461d-958f-c1f2f5546072 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:21:59.605512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c53cf-cba2-461d-958f-c1f2f5546072 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:21:59.605844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c53cf-cba2-461d-958f-c1f2f5546072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:21:59.606621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c53cf-cba2-461d-958f-c1f2f5546072 None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=8535cea602d743dfa892160338ebfd89) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:21:59.607033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c53cf-cba2-461d-958f-c1f2f5546072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:21:59.608618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c53cf-cba2-461d-958f-c1f2f5546072 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:21:59.614672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 606/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:21:59 2022] GET /identity/v3/role_assignments?user.id=8535cea602d743dfa892160338ebfd89&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:01.650892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb4ce-6d03-4c4b-89e8-6b6eb637e510 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:01.651543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb4ce-6d03-4c4b-89e8-6b6eb637e510 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:01.651543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb4ce-6d03-4c4b-89e8-6b6eb637e510 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:01.652847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 614/1220] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:01.658605 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607734c-0408-43c1-bbea-783da81e6f1d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:01.659087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607734c-0408-43c1-bbea-783da81e6f1d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:01.659200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607734c-0408-43c1-bbea-783da81e6f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:01.677644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b607734c-0408-43c1-bbea-783da81e6f1d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:01.678842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b607734c-0408-43c1-bbea-783da81e6f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:01.748755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 607/1221] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:01.771916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fb4ce-6d03-4c4b-89e8-6b6eb637e510 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:01.882331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fb4ce-6d03-4c4b-89e8-6b6eb637e510 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:01.920664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:01.921304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:01.921598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:01.921946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:01.933446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:22:01.938794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:01.940605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:01.942029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 615/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:22:01.946431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607734c-0408-43c1-bbea-783da81e6f1d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:02.055920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607734c-0408-43c1-bbea-783da81e6f1d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:02.080275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:02.093563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:02.094354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:02.094669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:02.095030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:02.095885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:02.096252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:02.097779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:02.106379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 608/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:22:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:22:02.112499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:02.160294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:02.221174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8462-e4d5-41fc-aba6-504c1638c50c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:02.262598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:02.263372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:02.263754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:02.264090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:02.277172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:02.279404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:02.296823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:02.297956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:02.299056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:02.299056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:02.299056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:02.299056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:02.299056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 616/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:02.304005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:02.408533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23a441-72d2-4131-9d71-8f8b98c35134 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:02.446322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:02.446982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:02.447297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:02.447569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:02.448300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:02.448603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:02.450043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:02.463003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 609/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:02.469062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:02.570780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:02.578444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f00b7-8813-4074-b3db-2ce78a052dea None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:02.613845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:02.614498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:02.614782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:02.615062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:02.623954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:02.625598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:22:02.637321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:02.638345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:02.639290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 617/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:22:02.644779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:02.698617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:02.756892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd38c25-37f9-49e3-97c8-4284b93f7338 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:02.792471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:02.793095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:02.793457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:02.793681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:02.794486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:02.794791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:02.796383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:02.814947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 610/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Jul 29 08:22:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:02.821726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:02.923668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6a6f-0672-4915-b50d-01f7dc5d2915 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:02.958529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:02.959296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:02.959618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:02.959914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:02.971481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:02.972933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:02.987415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:02.988429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:02.994234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:02.994234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:02.994234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:02.994234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:02.994234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 618/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:22:02.994526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:03.110063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb9abc-e25c-4d5f-ab4b-238c68c7203f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:03.112603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:03.149772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:03.150500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:03.150777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:03.151050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:03.151742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:03.152043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:03.153455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:03.165115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 611/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:03.171604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:03.183120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:03.288119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56802b93-0388-4edb-8b68-da3e159d9a04 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:03.327246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:03.327931 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:03.328267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:03.328575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:03.335996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:03.337477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:22:03.348841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:03.349984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:03.351202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 619/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:03.356106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:03.470438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1da755-3702-4240-98f8-6c780e29ced4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:03.507030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5decb5-ac80-4e78-8dee-f60f6fa75b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:03.507655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5decb5-ac80-4e78-8dee-f60f6fa75b9e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:03.507930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5decb5-ac80-4e78-8dee-f60f6fa75b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:03.508197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5decb5-ac80-4e78-8dee-f60f6fa75b9e None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:03.508938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5decb5-ac80-4e78-8dee-f60f6fa75b9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:03.509241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5decb5-ac80-4e78-8dee-f60f6fa75b9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:03.510712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5decb5-ac80-4e78-8dee-f60f6fa75b9e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:03.526187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 612/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:03.532628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:03.607625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:03.649781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380fc5-030e-4353-8096-0db973be0af8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:03.694418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319633bf-bee3-4195-ba68-370b0ef65480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:03.695251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319633bf-bee3-4195-ba68-370b0ef65480 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:03.695538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319633bf-bee3-4195-ba68-370b0ef65480 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:03.695882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319633bf-bee3-4195-ba68-370b0ef65480 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/8535cea602d743dfa892160338ebfd89/roles/69363a3115984b76a7def98b3e959add` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:03.711554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319633bf-bee3-4195-ba68-370b0ef65480 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=8535cea602d743dfa892160338ebfd89, role_id=69363a3115984b76a7def98b3e959add)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:03.714087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319633bf-bee3-4195-ba68-370b0ef65480 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:03.728476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 620/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:22:03 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/8535cea602d743dfa892160338ebfd89/roles/69363a3115984b76a7def98b3e959add => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:22:05.839486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36f49-2b25-4933-a57a-1ab48ea09c0b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:05.840040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36f49-2b25-4933-a57a-1ab48ea09c0b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:05.840040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36f49-2b25-4933-a57a-1ab48ea09c0b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:05.841437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 613/1233] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:05.846798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381d3d-9d75-4730-a0e3-2925c67b2910 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:05.847291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381d3d-9d75-4730-a0e3-2925c67b2910 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:05.847427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381d3d-9d75-4730-a0e3-2925c67b2910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:05.868333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-45381d3d-9d75-4730-a0e3-2925c67b2910 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:05.869749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-45381d3d-9d75-4730-a0e3-2925c67b2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:05.953326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 621/1234] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:05.979920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36f49-2b25-4933-a57a-1ab48ea09c0b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:06.009296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:06.098351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36f49-2b25-4933-a57a-1ab48ea09c0b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:06.136076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:06.136721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:06.137000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:06.137270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:06.147750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:22:06.152689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:06.153896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:06.154763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 614/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Jul 29 08:22:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:06.160342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45381d3d-9d75-4730-a0e3-2925c67b2910 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:06.208575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:06.264882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45381d3d-9d75-4730-a0e3-2925c67b2910 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:06.302800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:06.303554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:06.303848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:06.304139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:06.304941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:06.305308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:06.306890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:06.316375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 622/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Jul 29 08:22:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:22:06.323250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:06.416381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:06.434172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57de9-156e-4081-b988-2a86d0cd2a5a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:06.473142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:06.473815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:06.474100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:06.474374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:06.485144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:06.487072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:06.503096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:06.504145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:06.505043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:06.505043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:06.505043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:06.505043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:06.505043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 615/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:06.510317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:06.628520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7e9f-5169-4055-b016-1eb42445ecc4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:06.640013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:06.666562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:06.667226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:06.667575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:06.667921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:06.668721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:06.669122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:06.670798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:06.684873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 623/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:06.691289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:06.804344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd84162-e279-40fb-9d8a-53e9b1b071e7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:06.845486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:06.846402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:06.846666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:06.847039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:06.850698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:06.857801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:06.859512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:22:06.872126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:06.873399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:06.874566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 616/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:06.879949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:06.993250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b936-2edf-4686-8c29-f9c98c6b6189 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:07.032613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:07.033350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:07.033636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:07.033951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:07.034973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:07.035304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:07.036940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:07.058018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 624/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Jul 29 08:22:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:07.064282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:07.172751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc79be-c5a3-4e9e-9569-a04407890c46 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:07.213948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:07.214602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:07.214864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:07.215135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:07.290656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:07.297491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:07.298974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:07.404738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 617/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:22:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:22:07.410962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:07.442533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:07.519461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfd10a-5274-46fd-8478-2fac2609dede None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:07.561555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:07.562221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:07.562525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:07.562805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:07.573852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:07.575347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:07.591746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:07.593221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:07.594382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:07.594382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:07.594382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:07.594382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:07.594382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 625/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:22:07.599310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:07.699733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:07.705871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1a5bc-ebcb-4dc2-8b23-7685d2281d24 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:07.740832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:07.741523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:07.741778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:07.742050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:07.742738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:07.743044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:07.744439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:07.756392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 618/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:07.762400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:07.850261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:07.873396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc832c0-9246-4188-bdcf-bdfcc57e4194 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:07.911362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:07.912044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:07.912277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:07.912547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:07.919525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:07.921105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:22:07.932639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:07.933767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:07.934894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 626/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:07.939964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:08.054061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beda2d-4537-42ad-8f4a-016be25ffc3f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:08.092566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d370ce4-acb3-489a-8dd6-17585472f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:08.093234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d370ce4-acb3-489a-8dd6-17585472f177 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:08.093524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d370ce4-acb3-489a-8dd6-17585472f177 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:08.093813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d370ce4-acb3-489a-8dd6-17585472f177 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:08.094595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d370ce4-acb3-489a-8dd6-17585472f177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:08.094882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d370ce4-acb3-489a-8dd6-17585472f177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:08.096488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d370ce4-acb3-489a-8dd6-17585472f177 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:08.108856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 619/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:22:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:22:08.114976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:08.228723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff7de2-27f2-40a6-b4b8-3a1867141917 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:08.270101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4677b9-2c88-4c61-ae26-e64aba12166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:08.270756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4677b9-2c88-4c61-ae26-e64aba12166c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:08.271038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4677b9-2c88-4c61-ae26-e64aba12166c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:08.271316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4677b9-2c88-4c61-ae26-e64aba12166c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:08.272158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4677b9-2c88-4c61-ae26-e64aba12166c None admin] RBAC: Adding query filter params (role.id=69363a3115984b76a7def98b3e959add, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=8535cea602d743dfa892160338ebfd89) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:08.272602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4677b9-2c88-4c61-ae26-e64aba12166c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:08.274253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4677b9-2c88-4c61-ae26-e64aba12166c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:08.280631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 627/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:22:08 2022] GET /identity/v3/role_assignments?user.id=8535cea602d743dfa892160338ebfd89&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=69363a3115984b76a7def98b3e959add => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:10.412161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af9d4-84fe-4b93-94fb-6e4f14952081 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:10.412745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af9d4-84fe-4b93-94fb-6e4f14952081 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:10.412745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af9d4-84fe-4b93-94fb-6e4f14952081 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:10.414107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 620/1247] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:10.419814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3df5d-3d77-4c2d-a9c4-960e2fe491e5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:10.420269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3df5d-3d77-4c2d-a9c4-960e2fe491e5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:10.420414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3df5d-3d77-4c2d-a9c4-960e2fe491e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:10.427413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:10.441308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c2e3df5d-3d77-4c2d-a9c4-960e2fe491e5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:10.442551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c2e3df5d-3d77-4c2d-a9c4-960e2fe491e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:10.512368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 628/1248] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:10.535653 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af9d4-84fe-4b93-94fb-6e4f14952081 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:10.555972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:10.651075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af9d4-84fe-4b93-94fb-6e4f14952081 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:10.688094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:10.688717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:10.688993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:10.689260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:10.701480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:22:10.706917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:10.708023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:10.709273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 621/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:22:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:10.714828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3df5d-3d77-4c2d-a9c4-960e2fe491e5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:10.819215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3df5d-3d77-4c2d-a9c4-960e2fe491e5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:10.850697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:10.856687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:10.857375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:10.857763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:10.858106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:10.859057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:10.859368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:10.860905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:10.875084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 629/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:22:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:10.877023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:10.958203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:10.982909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d161d-6f74-4fd0-af07-8bfc6652072e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:11.017869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:11.018515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:11.018792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:11.019069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:11.031876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:11.033960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:11.054964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:11.056104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:11.057389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:11.057389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:11.057389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:11.057389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:11.057389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 622/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:11.063983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:11.179887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d14ef-0c9a-4329-944b-c0fa54624a6e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:11.218427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:11.219214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:11.219556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:11.219852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:11.220719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:11.221120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:11.223193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:11.237743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 630/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:11.244749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:11.357706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6df4a-139e-4b37-843d-5ba8b8ca1754 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:11.387654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:11.397492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:11.398245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:11.398540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:11.398801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:11.406976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:11.408453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:22:11.422511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:11.424117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:11.426987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 623/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:11.431493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:11.495373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:11.545659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d19b-cc3f-4f8e-9e27-71296893c0e7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:11.587016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:11.587780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:11.588098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:11.588392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:11.589321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:11.589635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:11.591350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:11.613055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 631/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Jul 29 08:22:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:11.618687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:11.738178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4be2b-3225-4231-a04b-5454380dc3d1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:11.772335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:11.772932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:11.773214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:11.773515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:11.836582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:11.849479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:11.850962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:11.954608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 624/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:22:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 08:22:11.961223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:12.081150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe23a2-6a74-4984-a2c4-f7e1c08926a9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:12.097546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:12.122994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:12.123646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:12.123961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:12.124237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:12.135402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:12.136920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:12.151597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:12.152639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:12.153746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:12.153746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:12.153746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:12.153746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:12.153746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 632/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:12.159500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:12.258586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:12.271807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b57c9e-152b-4bcf-8446-0043f1bb9957 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:12.310859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:12.311699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:12.312052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:12.312324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:12.313017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:12.313348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:12.314916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:12.330886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 625/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:12.337718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:12.455511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff3a25-02e1-4b12-8d28-bf7984a89c45 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:12.495696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:12.496445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:12.496734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:12.497035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:12.505310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:12.506800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:22:12.519095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:12.520748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:12.522022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 633/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:12.526555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:12.638773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba481976-633f-4da1-9a4e-6710d4eb5c5e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:12.681408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf2b06-575d-43d7-b26c-75c783dec80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:12.682124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf2b06-575d-43d7-b26c-75c783dec80e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:12.682408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf2b06-575d-43d7-b26c-75c783dec80e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:12.682732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf2b06-575d-43d7-b26c-75c783dec80e None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:12.683656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf2b06-575d-43d7-b26c-75c783dec80e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:12.684023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf2b06-575d-43d7-b26c-75c783dec80e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:12.685814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf2b06-575d-43d7-b26c-75c783dec80e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:12.699870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 626/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:12.712498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:12.743137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:12.828115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc175-494f-4031-ac4e-c1f3881810be None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:12.864994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8f9d-0d37-4567-b4a3-ef8b8d6422e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:12.865654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8f9d-0d37-4567-b4a3-ef8b8d6422e5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:12.865941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8f9d-0d37-4567-b4a3-ef8b8d6422e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:12.866219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8f9d-0d37-4567-b4a3-ef8b8d6422e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:12.867023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d8f9d-0d37-4567-b4a3-ef8b8d6422e5 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=8535cea602d743dfa892160338ebfd89) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:12.867345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d8f9d-0d37-4567-b4a3-ef8b8d6422e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:12.868784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d8f9d-0d37-4567-b4a3-ef8b8d6422e5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:12.874300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 634/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:22:12 2022] GET /identity/v3/role_assignments?user.id=8535cea602d743dfa892160338ebfd89&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:14.918219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2711e-0fa5-4223-aed9-aa2c5e5aee02 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:14.918773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2711e-0fa5-4223-aed9-aa2c5e5aee02 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:14.918773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2711e-0fa5-4223-aed9-aa2c5e5aee02 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:14.920152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 627/1261] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:14.925665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45bba-68f5-4a49-bccf-835f035575eb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:14.926086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45bba-68f5-4a49-bccf-835f035575eb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:14.926200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45bba-68f5-4a49-bccf-835f035575eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:14.944870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-66b45bba-68f5-4a49-bccf-835f035575eb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:14.946109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-66b45bba-68f5-4a49-bccf-835f035575eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:15.019819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 635/1262] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:15.045118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2711e-0fa5-4223-aed9-aa2c5e5aee02 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:15.057516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:15.159718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2711e-0fa5-4223-aed9-aa2c5e5aee02 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:15.193235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:15.193839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:15.194122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:15.194395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:15.205405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:22:15.210715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:15.211782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:15.212968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 628/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:15.220141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45bba-68f5-4a49-bccf-835f035575eb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:15.239780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:15.323067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45bba-68f5-4a49-bccf-835f035575eb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:15.359042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:15.359663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:15.359939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:15.360216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:15.360933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:15.361238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:15.362634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:15.370759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 636/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:15.377901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:15.448775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:15.495272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971a5b-85d2-46a2-8764-e1e6e481294e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:15.530321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:15.530949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:15.531230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:15.531493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:15.542058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:15.543518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:15.560060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:15.561076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:15.562104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:15.562104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:15.562104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:15.562104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:15.562104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 629/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:15.567199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:15.646929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:15.673407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6555-2049-4a54-ab1b-61b343d4671a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:15.708854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:15.709437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:15.709716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:15.709998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:15.711055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:15.711361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:15.712738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:15.724846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 637/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:15.733577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:15.837093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38fd4-d949-4857-a1fc-3b4b4915359f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:15.856814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:15.872586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:15.873225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:15.873579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:15.873861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:15.881155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:15.882608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:22:15.893903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:15.894956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:15.896302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 630/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:15.901057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:16.006170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43225e-ce17-4e87-b2cc-bb7b12012d3d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:16.046427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:16.047117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:16.047478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:16.047770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:16.048708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:16.049062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:16.050703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:16.060757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:16.070521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 638/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Jul 29 08:22:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:16.076607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:16.177323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66405bd8-7a6a-4934-8eeb-8c73da4cf43b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:16.214687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:16.215621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:16.215986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:16.216357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:16.229157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:16.230649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:16.244970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:16.245986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:16.247037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:16.247037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:16.247037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:16.247037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:16.247037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 631/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:16.251960 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:16.360592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7329394-c6f8-4d3d-8f32-7224f1aef07b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:16.396107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:16.396717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:16.397000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:16.397312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:16.398009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:16.398323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:16.399693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:16.411013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 639/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:16.417794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:16.451388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:16.525621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e168-cad5-4930-9edc-cd2ad957b2c9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:16.563983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:16.564624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:16.564902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:16.565186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:16.572433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:16.573954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:22:16.586019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:16.587017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:16.588084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 632/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:22:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:16.593494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:16.665378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:16.707964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548caf6-ede4-4d83-80f1-a9731f4b442c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:16.743505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a92e4-958f-4121-86de-e8564c41b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:16.744122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a92e4-958f-4121-86de-e8564c41b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:16.744403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a92e4-958f-4121-86de-e8564c41b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:16.744679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a92e4-958f-4121-86de-e8564c41b2e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:16.745536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a92e4-958f-4121-86de-e8564c41b2e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:16.745847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a92e4-958f-4121-86de-e8564c41b2e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:16.747292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a92e4-958f-4121-86de-e8564c41b2e6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:16.760112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 640/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:16.766676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:16.863476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:16.875912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871364c-e323-4f38-9c76-b619d1dee561 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:16.913312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a6f3-9bbd-4bd7-8c62-68a7bd758477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:16.914019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a6f3-9bbd-4bd7-8c62-68a7bd758477 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:16.914275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a6f3-9bbd-4bd7-8c62-68a7bd758477 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:16.914555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a6f3-9bbd-4bd7-8c62-68a7bd758477 None admin] PATH_INFO: `/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/8535cea602d743dfa892160338ebfd89/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:16.916748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a6f3-9bbd-4bd7-8c62-68a7bd758477 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5b9fc19454a10822fbe087a81423c, user_id=8535cea602d743dfa892160338ebfd89, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:16.918184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a6f3-9bbd-4bd7-8c62-68a7bd758477 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:16.933720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 633/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Jul 29 08:22:16 2022] PUT /identity/v3/projects/ccd5b9fc19454a10822fbe087a81423c/users/8535cea602d743dfa892160338ebfd89/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:22:18.878205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6988f-ed35-42b7-b98d-bfd73c13d57e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:18.878870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6988f-ed35-42b7-b98d-bfd73c13d57e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:18.878870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6988f-ed35-42b7-b98d-bfd73c13d57e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:18.880122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 641/1274] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:18.886396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122419-3037-4aa5-91fa-3c7a8cd38636 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:18.887136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122419-3037-4aa5-91fa-3c7a8cd38636 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:18.887305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122419-3037-4aa5-91fa-3c7a8cd38636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:18.913073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ba122419-3037-4aa5-91fa-3c7a8cd38636 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:18.914319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ba122419-3037-4aa5-91fa-3c7a8cd38636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:18.988317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 634/1275] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:19.015315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6988f-ed35-42b7-b98d-bfd73c13d57e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:19.153678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6988f-ed35-42b7-b98d-bfd73c13d57e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:19.169976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:19.187901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:19.188551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:19.188835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:19.189105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:19.199488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 08:22:19.204552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:19.205712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:19.206632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 642/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Jul 29 08:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:19.214911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122419-3037-4aa5-91fa-3c7a8cd38636 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:19.305815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:19.327537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122419-3037-4aa5-91fa-3c7a8cd38636 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:19.362738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:19.363357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:19.363635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:19.363920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:19.364628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:19.364938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:19.366360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:19.374623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 635/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Jul 29 08:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:19.380628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:19.490390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5372f3-c623-4ca2-ad33-4eddbd1aebee None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:19.525740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:19.526376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:19.526662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:19.526935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:19.537437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:19.538891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:19.554495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:19.555557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:19.556634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:19.556634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:19.556634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:19.556634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:19.556634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 643/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:19.561920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:19.681731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a05d9-de4d-485c-87fd-638ffd6195f3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:19.719111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:19.719718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:19.719995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:19.720267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:19.720952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:19.721252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:19.723005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:19.734726 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 636/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:19.743405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:19.777554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:19.863889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b6c1-dfa0-41bf-8d34-ceb9dc540ac2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:19.898579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:19.899233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:19.899472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:19.899743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:19.907335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:19.908765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 08:22:19.919965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:19.921107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:19.922473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 644/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:19.928174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:19.932140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:20.035599 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81454d-9fae-4282-8168-068973bf641b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:20.071940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:20.072556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:20.072838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:20.073112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:20.073945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:20.074256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:20.075708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:20.093183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 637/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Jul 29 08:22:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:22:20.099242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:20.205578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:20.216189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a1f63-e6fe-41f4-8cfe-6b607b61bc58 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:20.252932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:20.253583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:20.253868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:20.254154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:20.327536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:20.328913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:20.420779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:20.433716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 645/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Jul 29 08:22:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 08:22:20.439832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:20.505105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:20.551855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195e918-7329-4b19-ae61-584c935a24a6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:20.588624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:20.589258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:20.589568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:20.589843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:20.600397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:20.601900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 08:22:20.616635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:20.617737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:20.618879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 08:22:20.618879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 08:22:20.618879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 08:22:20.618879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:20.621478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 638/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 08:22:20.623645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:20.734219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dd9aa-2ab5-4c55-a85b-6644c82f20e2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:20.769485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:20.770100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:20.770386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:20.770661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:20.771360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:20.771673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:20.773055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:20.784409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 646/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Jul 29 08:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:20.792797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:20.895420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4dab2-f69a-436f-a482-1e8e429284d2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:20.908969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:20.934487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:20.935104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:20.935392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:20.935667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:20.943301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:20.944761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 08:22:20.958480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:20.959472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Jul 29 08:22:20.960863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 639/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Jul 29 08:22:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:20.966044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:21.018028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:21.071396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672c4f3-8514-4c3e-87a9-e29fd011b838 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:21.114784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca217fc4-5d5f-456d-b097-a8a2e326d7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:21.115397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217fc4-5d5f-456d-b097-a8a2e326d7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:21.115682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217fc4-5d5f-456d-b097-a8a2e326d7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:21.115952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217fc4-5d5f-456d-b097-a8a2e326d7e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:21.116694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217fc4-5d5f-456d-b097-a8a2e326d7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:21.117001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217fc4-5d5f-456d-b097-a8a2e326d7e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:21.118469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217fc4-5d5f-456d-b097-a8a2e326d7e1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:21.131545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 647/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Jul 29 08:22:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:21.140765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:21.244679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e615-d856-42b0-8e8f-9398dd43dccc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:21.292043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352442b1-652d-4556-af55-9f91eba64b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:21.292655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352442b1-652d-4556-af55-9f91eba64b37 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:21.292935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352442b1-652d-4556-af55-9f91eba64b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:21.293207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352442b1-652d-4556-af55-9f91eba64b37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:21.294031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352442b1-652d-4556-af55-9f91eba64b37 None admin] RBAC: Adding query filter params (role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b, scope.project.id=ccd5b9fc19454a10822fbe087a81423c, user.id=8535cea602d743dfa892160338ebfd89) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:21.294340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352442b1-652d-4556-af55-9f91eba64b37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:21.295785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352442b1-652d-4556-af55-9f91eba64b37 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:21.302143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 640/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Jul 29 08:22:21 2022] GET /identity/v3/role_assignments?user.id=8535cea602d743dfa892160338ebfd89&scope.project.id=ccd5b9fc19454a10822fbe087a81423c&role.id=8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:22:23.312565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d20e4-7add-49d1-a28c-1d3a010a89c7 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:23.313624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d20e4-7add-49d1-a28c-1d3a010a89c7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:23.313624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d20e4-7add-49d1-a28c-1d3a010a89c7 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:23.315756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 648/1288] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:23.323526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183f1a-3efc-4e55-83b5-71a5a55b609f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:23.323960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183f1a-3efc-4e55-83b5-71a5a55b609f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:23.324076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183f1a-3efc-4e55-83b5-71a5a55b609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:23.344276 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a9183f1a-3efc-4e55-83b5-71a5a55b609f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:23.345497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a9183f1a-3efc-4e55-83b5-71a5a55b609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:23.375441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:23.414202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 641/1289] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 08:22:23.436549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d20e4-7add-49d1-a28c-1d3a010a89c7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:23.555143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d20e4-7add-49d1-a28c-1d3a010a89c7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:23.566665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:23.593199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:23.593931 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:23.594208 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:23.594480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:23.595104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:23.596469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:23.605714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:23.606851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:23.607771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 649/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:22:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:23.612984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9183f1a-3efc-4e55-83b5-71a5a55b609f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:23.716265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9183f1a-3efc-4e55-83b5-71a5a55b609f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:23.762304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a517fd8-528d-42ef-891c-644cfb15c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:23.763200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a517fd8-528d-42ef-891c-644cfb15c55d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:23.763562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a517fd8-528d-42ef-891c-644cfb15c55d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:23.763991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a517fd8-528d-42ef-891c-644cfb15c55d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:23.765205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a517fd8-528d-42ef-891c-644cfb15c55d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:23.765205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a517fd8-528d-42ef-891c-644cfb15c55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:23.766414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a517fd8-528d-42ef-891c-644cfb15c55d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:23.771803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 642/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Jul 29 08:22:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:23.777852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:23.889458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7239bd1-0e67-48c6-aeb7-b97de37b1223 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:23.924427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f08ca-b0ab-4b94-aaa1-656f85155e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:23.925027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f08ca-b0ab-4b94-aaa1-656f85155e84 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:23.925326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f08ca-b0ab-4b94-aaa1-656f85155e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:23.925610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f08ca-b0ab-4b94-aaa1-656f85155e84 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:23.926279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f08ca-b0ab-4b94-aaa1-656f85155e84 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:23.926581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f08ca-b0ab-4b94-aaa1-656f85155e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:23.927944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f08ca-b0ab-4b94-aaa1-656f85155e84 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:23.932473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 650/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Jul 29 08:22:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:25.955031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d474944-6c31-41ee-b7be-68a2d84ed155 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:25.955625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d474944-6c31-41ee-b7be-68a2d84ed155 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:25.955625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d474944-6c31-41ee-b7be-68a2d84ed155 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:25.956941 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 643/1293] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:25.963602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbb837-97ee-470a-b8d2-b99ef5077e1d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:25.964340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbb837-97ee-470a-b8d2-b99ef5077e1d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:25.964471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbb837-97ee-470a-b8d2-b99ef5077e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:25.990806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a6dbb837-97ee-470a-b8d2-b99ef5077e1d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:25.991994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a6dbb837-97ee-470a-b8d2-b99ef5077e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:26.023269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:26.070023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 651/1294] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:26.104249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d474944-6c31-41ee-b7be-68a2d84ed155 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:26.136731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:26.211597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d474944-6c31-41ee-b7be-68a2d84ed155 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:26.247669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b05f2-cca7-45cc-bad1-8b9ab30e786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:26.248363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b05f2-cca7-45cc-bad1-8b9ab30e786e None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:26.248641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b05f2-cca7-45cc-bad1-8b9ab30e786e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:26.248917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b05f2-cca7-45cc-bad1-8b9ab30e786e None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:26.249646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b05f2-cca7-45cc-bad1-8b9ab30e786e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:26.251030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b05f2-cca7-45cc-bad1-8b9ab30e786e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:26.269694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 644/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Jul 29 08:22:26 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:22:28.231960 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac914-4f8c-4ce4-b95a-5be27f3be9d0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:28.232993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac914-4f8c-4ce4-b95a-5be27f3be9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:28.232993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac914-4f8c-4ce4-b95a-5be27f3be9d0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:28.235115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 652/1296] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:28.241444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3dcd2-faf8-462c-b9e4-1ff4d360898a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:28.241868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3dcd2-faf8-462c-b9e4-1ff4d360898a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:28.242040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3dcd2-faf8-462c-b9e4-1ff4d360898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:28.268134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-90d3dcd2-faf8-462c-b9e4-1ff4d360898a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:28.269374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-90d3dcd2-faf8-462c-b9e4-1ff4d360898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:28.348148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 645/1297] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:28.377082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac914-4f8c-4ce4-b95a-5be27f3be9d0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:28.490943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac914-4f8c-4ce4-b95a-5be27f3be9d0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:28.525764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:28.526397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:28.526677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:28.526948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:28.527569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:28.528954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:28.538104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:28.539230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:28.540481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 653/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:22:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:28.545802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3dcd2-faf8-462c-b9e4-1ff4d360898a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:28.565568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:28.659067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3dcd2-faf8-462c-b9e4-1ff4d360898a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:28.694104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:28.694720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:28.695000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:28.695272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:28.695949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:28.696254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:28.697673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:28.704009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 646/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Jul 29 08:22:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:22:28.714058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:28.754209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:28.834542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d98d1-178f-462f-9de2-c7c0f295bc06 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:28.869902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73248772-04ee-42e0-a37f-700fa3a94ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:28.870522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248772-04ee-42e0-a37f-700fa3a94ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:28.870805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248772-04ee-42e0-a37f-700fa3a94ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:28.871079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248772-04ee-42e0-a37f-700fa3a94ed1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:28.871847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73248772-04ee-42e0-a37f-700fa3a94ed1 None admin] RBAC: Adding query filter params (interface=public, service_id=b55ab23ba2134091a60f65c38dfac262, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:28.872165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73248772-04ee-42e0-a37f-700fa3a94ed1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:28.873628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73248772-04ee-42e0-a37f-700fa3a94ed1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:28.878887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 654/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Jul 29 08:22:28 2022] GET /identity/v3/endpoints?service_id=b55ab23ba2134091a60f65c38dfac262&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:28.884794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:28.979166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:28.999324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834994e-33e0-4d72-8fa9-bf58d89ccdcf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:29.036705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d185477-5320-419d-89a5-ba08e3a9c2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:29.037344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d185477-5320-419d-89a5-ba08e3a9c2eb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:29.037709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d185477-5320-419d-89a5-ba08e3a9c2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:29.037991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d185477-5320-419d-89a5-ba08e3a9c2eb None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:29.038740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d185477-5320-419d-89a5-ba08e3a9c2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:29.040476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d185477-5320-419d-89a5-ba08e3a9c2eb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:29.050827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 647/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Jul 29 08:22:28 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:22:30.996306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8f4f-2d2d-4101-bf6f-b3aac1d195e8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:30.997201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8f4f-2d2d-4101-bf6f-b3aac1d195e8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:30.997201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8f4f-2d2d-4101-bf6f-b3aac1d195e8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:30.999066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 655/1302] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:22:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:22:31.005334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77885aa1-3ba7-47cf-868d-f735df14a046 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:31.005743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77885aa1-3ba7-47cf-868d-f735df14a046 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:31.005898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77885aa1-3ba7-47cf-868d-f735df14a046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:31.033721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-77885aa1-3ba7-47cf-868d-f735df14a046 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:22:31.034921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-77885aa1-3ba7-47cf-868d-f735df14a046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:22:31.106083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 648/1303] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:22:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 08:22:31.135149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc8f4f-2d2d-4101-bf6f-b3aac1d195e8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:31.242060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:31.253717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc8f4f-2d2d-4101-bf6f-b3aac1d195e8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:31.294575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:31.295246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:31.295521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:31.295794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:31.296418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:31.297818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 08:22:31.306961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 08:22:31.308070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Jul 29 08:22:31.309020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 656/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Jul 29 08:22:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 08:22:31.314688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77885aa1-3ba7-47cf-868d-f735df14a046 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:31.397702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:31.427148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77885aa1-3ba7-47cf-868d-f735df14a046 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:31.464189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af89752-27d9-4adf-9b41-fa73ef15d53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:31.465111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af89752-27d9-4adf-9b41-fa73ef15d53f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:31.465521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af89752-27d9-4adf-9b41-fa73ef15d53f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:31.465873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af89752-27d9-4adf-9b41-fa73ef15d53f None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:31.466912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af89752-27d9-4adf-9b41-fa73ef15d53f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:22:31.467345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af89752-27d9-4adf-9b41-fa73ef15d53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:31.469538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af89752-27d9-4adf-9b41-fa73ef15d53f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:31.478462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 649/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Jul 29 08:22:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:22:31.485846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:22:31.588647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326cad-bb5f-4e1f-9df0-31450d1b23a4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:22:31.627275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c9cb-bfbe-4908-8f70-22eb1c4d7da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:22:31.627880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c9cb-bfbe-4908-8f70-22eb1c4d7da3 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:22:31.628161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c9cb-bfbe-4908-8f70-22eb1c4d7da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:22:31.628432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c9cb-bfbe-4908-8f70-22eb1c4d7da3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:22:31.629142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c9cb-bfbe-4908-8f70-22eb1c4d7da3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:22:31.630530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c9cb-bfbe-4908-8f70-22eb1c4d7da3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:22:31.656592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 657/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:22:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:22:41.473248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=30 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:22:41.651981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:34.237794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aef862-88c1-46f9-85f3-9b27e723c107 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:34.238386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aef862-88c1-46f9-85f3-9b27e723c107 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:34.238386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aef862-88c1-46f9-85f3-9b27e723c107 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:34.239869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 650/1307] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:34.245402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca020c35-013c-4092-9b9c-eae93667a778 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:34.245891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca020c35-013c-4092-9b9c-eae93667a778 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:34.246000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca020c35-013c-4092-9b9c-eae93667a778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:34.338775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ca020c35-013c-4092-9b9c-eae93667a778 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:34.340023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca020c35-013c-4092-9b9c-eae93667a778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:34.492546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 658/1308] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:34.549107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6de2-9f72-4892-9c4e-76b0d4e649bc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:34.549421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6de2-9f72-4892-9c4e-76b0d4e649bc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:34.549613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6de2-9f72-4892-9c4e-76b0d4e649bc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:34.551092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 651/1309] 10.222.0.47 () {54 vars in 965 bytes} [Fri Jul 29 08:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:34.558851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77c73f-58fe-4211-96f8-2b5597b926d9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:34.559210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77c73f-58fe-4211-96f8-2b5597b926d9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:34.559577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77c73f-58fe-4211-96f8-2b5597b926d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:34.683130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4e77c73f-58fe-4211-96f8-2b5597b926d9 None None] MFA Rules not processed for user `2929dcc2eee6498393466499b61d6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:34.693656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4e77c73f-58fe-4211-96f8-2b5597b926d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:34.718469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:34.780981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 659/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Fri Jul 29 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:34.790282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6de2-9f72-4892-9c4e-76b0d4e649bc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:34.792104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e18e6de2-9f72-4892-9c4e-76b0d4e649bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:34.903843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6de2-9f72-4892-9c4e-76b0d4e649bc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:34.982368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d252b-f901-4109-a5fc-34d0dae084cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:34.982991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d252b-f901-4109-a5fc-34d0dae084cb service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:34.983263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d252b-f901-4109-a5fc-34d0dae084cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:34.983639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d252b-f901-4109-a5fc-34d0dae084cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:34.985202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e46d252b-f901-4109-a5fc-34d0dae084cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:35.042838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:35.100821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d252b-f901-4109-a5fc-34d0dae084cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:35.102469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d252b-f901-4109-a5fc-34d0dae084cb service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:35.121885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 652/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:23:37.428064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911de3f-e77a-4d72-b141-4b8e13683bc3 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:37.428612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911de3f-e77a-4d72-b141-4b8e13683bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:37.428612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911de3f-e77a-4d72-b141-4b8e13683bc3 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:37.430124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 660/1312] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:37.435631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194e1c-6db3-4fae-90ca-90eaf935f0f4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:37.436245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194e1c-6db3-4fae-90ca-90eaf935f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:37.436245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194e1c-6db3-4fae-90ca-90eaf935f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:37.516015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c5194e1c-6db3-4fae-90ca-90eaf935f0f4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:37.517140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c5194e1c-6db3-4fae-90ca-90eaf935f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:37.624270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 653/1313] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:37.666116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911de3f-e77a-4d72-b141-4b8e13683bc3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:37.667732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a911de3f-e77a-4d72-b141-4b8e13683bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:37.790009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911de3f-e77a-4d72-b141-4b8e13683bc3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:37.868812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:37.871665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6de4d-b484-4b92-aafe-ba36a94668b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:37.872387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6de4d-b484-4b92-aafe-ba36a94668b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:37.872684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6de4d-b484-4b92-aafe-ba36a94668b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:37.872959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6de4d-b484-4b92-aafe-ba36a94668b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:37.875148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64a6de4d-b484-4b92-aafe-ba36a94668b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:37.992814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6de4d-b484-4b92-aafe-ba36a94668b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:37.994300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6de4d-b484-4b92-aafe-ba36a94668b9 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:38.012927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 661/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:23:40.347662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4462-1250-428f-82f0-21adee190e68 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:40.348252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4462-1250-428f-82f0-21adee190e68 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:40.348252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4462-1250-428f-82f0-21adee190e68 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:40.349643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 654/1315] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:40.354889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec118ef-5844-4a16-adff-605f0bffe5a4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:40.355307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec118ef-5844-4a16-adff-605f0bffe5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:40.355420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec118ef-5844-4a16-adff-605f0bffe5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:40.421803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fec118ef-5844-4a16-adff-605f0bffe5a4 None None] MFA Rules not processed for user `bd86b132728e4bdb90e02c8095adc0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:40.423005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fec118ef-5844-4a16-adff-605f0bffe5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:40.476866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:40.522655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 662/1316] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:40.576883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbaf4-fd31-4743-bdac-21808b139a50 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:40.577161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbaf4-fd31-4743-bdac-21808b139a50 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:40.577475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbaf4-fd31-4743-bdac-21808b139a50 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:40.578928 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 655/1317] 10.222.0.47 () {54 vars in 965 bytes} [Fri Jul 29 08:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:40.585315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f56459-a08d-418d-8aef-57009ab4fcb9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:40.585734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f56459-a08d-418d-8aef-57009ab4fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:40.586013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f56459-a08d-418d-8aef-57009ab4fcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:40.664007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-19f56459-a08d-418d-8aef-57009ab4fcb9 None None] MFA Rules not processed for user `2929dcc2eee6498393466499b61d6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:40.665242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-19f56459-a08d-418d-8aef-57009ab4fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:40.743870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 663/1318] 10.222.0.47 () {58 vars in 1062 bytes} [Fri Jul 29 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:40.753259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bbaf4-fd31-4743-bdac-21808b139a50 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:40.756166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b75bbaf4-fd31-4743-bdac-21808b139a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:40.766247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:40.868762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bbaf4-fd31-4743-bdac-21808b139a50 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:40.942639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395375b-76de-4aad-9eb9-9d5520afa6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:40.943273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395375b-76de-4aad-9eb9-9d5520afa6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:40.943553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395375b-76de-4aad-9eb9-9d5520afa6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:40.943827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395375b-76de-4aad-9eb9-9d5520afa6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:40.945513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2395375b-76de-4aad-9eb9-9d5520afa6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:41.013120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:41.065667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395375b-76de-4aad-9eb9-9d5520afa6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:41.067037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395375b-76de-4aad-9eb9-9d5520afa6c5 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:41.086005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 656/1319] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:23:44.013828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280618c6-0232-4bda-b1bb-e4c147118c1b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:44.014471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280618c6-0232-4bda-b1bb-e4c147118c1b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:44.014585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280618c6-0232-4bda-b1bb-e4c147118c1b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:44.015883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 664/1320] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:44.021270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c6b6-7297-4277-87e2-db4f75114cd7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:44.021759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c6b6-7297-4277-87e2-db4f75114cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:44.021848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c6b6-7297-4277-87e2-db4f75114cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:44.092102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-15b5c6b6-7297-4277-87e2-db4f75114cd7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:44.093313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-15b5c6b6-7297-4277-87e2-db4f75114cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:44.193501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 657/1321] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:44.235653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280618c6-0232-4bda-b1bb-e4c147118c1b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:44.237208 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-280618c6-0232-4bda-b1bb-e4c147118c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:44.289244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:44.346659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280618c6-0232-4bda-b1bb-e4c147118c1b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:44.426076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f08a9-23c1-40be-87de-1076a9054ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:44.426695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f08a9-23c1-40be-87de-1076a9054ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:44.426971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f08a9-23c1-40be-87de-1076a9054ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:44.427248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f08a9-23c1-40be-87de-1076a9054ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:44.428865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-991f08a9-23c1-40be-87de-1076a9054ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:44.534600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:44.554206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f08a9-23c1-40be-87de-1076a9054ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:44.556303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f08a9-23c1-40be-87de-1076a9054ce4 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:44.576611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 665/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:23:47.261082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc664bb-cba8-4f73-83d2-46a771b4d008 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:47.261587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc664bb-cba8-4f73-83d2-46a771b4d008 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:47.261678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc664bb-cba8-4f73-83d2-46a771b4d008 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:47.263094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 658/1323] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:47.268662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44472a85-2683-40af-9f4a-95dfae08c114 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:47.269416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44472a85-2683-40af-9f4a-95dfae08c114 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:47.269416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44472a85-2683-40af-9f4a-95dfae08c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:47.337198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-44472a85-2683-40af-9f4a-95dfae08c114 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:47.338517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-44472a85-2683-40af-9f4a-95dfae08c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:47.447537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 666/1324] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:47.485242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc664bb-cba8-4f73-83d2-46a771b4d008 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:47.486847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2fc664bb-cba8-4f73-83d2-46a771b4d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:47.508485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:47.600683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc664bb-cba8-4f73-83d2-46a771b4d008 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:47.678149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f1443-fdc3-4b65-a9fb-c4656bb18810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:47.678780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1443-fdc3-4b65-a9fb-c4656bb18810 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:47.679054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1443-fdc3-4b65-a9fb-c4656bb18810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:47.679322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1443-fdc3-4b65-a9fb-c4656bb18810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:47.681000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-329f1443-fdc3-4b65-a9fb-c4656bb18810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:47.755937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:47.796051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f1443-fdc3-4b65-a9fb-c4656bb18810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:47.797556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f1443-fdc3-4b65-a9fb-c4656bb18810 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:47.815571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 659/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:23:49.864994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b80fc-afca-45bd-927e-a41299c9406a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:49.865607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b80fc-afca-45bd-927e-a41299c9406a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:49.865607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b80fc-afca-45bd-927e-a41299c9406a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:49.866956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 667/1326] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:49.872281 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912da47-3bfd-482d-8b12-f462b258db56 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:49.872713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912da47-3bfd-482d-8b12-f462b258db56 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:49.872800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912da47-3bfd-482d-8b12-f462b258db56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:49.940384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3912da47-3bfd-482d-8b12-f462b258db56 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:49.941635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3912da47-3bfd-482d-8b12-f462b258db56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:50.045468 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 660/1327] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:50.081639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b80fc-afca-45bd-927e-a41299c9406a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:50.083601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b92b80fc-afca-45bd-927e-a41299c9406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:50.149537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:50.194804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b80fc-afca-45bd-927e-a41299c9406a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:50.274489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8e468-efe8-4245-85e5-6b84b3365f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:50.275114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8e468-efe8-4245-85e5-6b84b3365f26 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:50.275388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8e468-efe8-4245-85e5-6b84b3365f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:50.275671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8e468-efe8-4245-85e5-6b84b3365f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:50.277307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e3d8e468-efe8-4245-85e5-6b84b3365f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:50.386847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:50.389396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8e468-efe8-4245-85e5-6b84b3365f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:50.391120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8e468-efe8-4245-85e5-6b84b3365f26 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:50.409775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 668/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:23:52.432736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f809287-5d31-4202-a638-7367f98d23b9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:52.433411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f809287-5d31-4202-a638-7367f98d23b9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:52.433411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f809287-5d31-4202-a638-7367f98d23b9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:52.434677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 661/1329] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:52.440225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c78ed-db1d-4934-858f-ddb3eb9849fb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:52.440679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c78ed-db1d-4934-858f-ddb3eb9849fb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:52.440781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c78ed-db1d-4934-858f-ddb3eb9849fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:52.509654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3d0c78ed-db1d-4934-858f-ddb3eb9849fb None None] MFA Rules not processed for user `bd86b132728e4bdb90e02c8095adc0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:52.510897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d0c78ed-db1d-4934-858f-ddb3eb9849fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:52.614453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 669/1330] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:52.652793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f809287-5d31-4202-a638-7367f98d23b9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:52.654426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9f809287-5d31-4202-a638-7367f98d23b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:52.687293 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:52.768052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f809287-5d31-4202-a638-7367f98d23b9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:52.845144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a407682-e51e-4af8-8c4f-03c54412c3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:52.845860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a407682-e51e-4af8-8c4f-03c54412c3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:52.846142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a407682-e51e-4af8-8c4f-03c54412c3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:52.846417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a407682-e51e-4af8-8c4f-03c54412c3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:52.848294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3a407682-e51e-4af8-8c4f-03c54412c3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:52.929342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:52.962657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a407682-e51e-4af8-8c4f-03c54412c3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:52.964023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a407682-e51e-4af8-8c4f-03c54412c3f0 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:52.982541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 662/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:23:55.240395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c0aa-3f89-4f9e-bacc-ae092cb3cd61 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:55.240972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c0aa-3f89-4f9e-bacc-ae092cb3cd61 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:55.240972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c0aa-3f89-4f9e-bacc-ae092cb3cd61 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:55.242317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 670/1332] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:55.247743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071481-ca16-47e4-964d-aa7d80d47783 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:55.248171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071481-ca16-47e4-964d-aa7d80d47783 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:55.248286 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071481-ca16-47e4-964d-aa7d80d47783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:55.324006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6b071481-ca16-47e4-964d-aa7d80d47783 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:55.325947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6b071481-ca16-47e4-964d-aa7d80d47783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:55.430353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 663/1333] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:55.470088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594c0aa-3f89-4f9e-bacc-ae092cb3cd61 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:55.471632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2594c0aa-3f89-4f9e-bacc-ae092cb3cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:55.544087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:55.583864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594c0aa-3f89-4f9e-bacc-ae092cb3cd61 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:55.663264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454148e4-61f8-4b7c-9265-7a5daadb1650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:55.663898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454148e4-61f8-4b7c-9265-7a5daadb1650 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:55.664181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454148e4-61f8-4b7c-9265-7a5daadb1650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:55.664456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454148e4-61f8-4b7c-9265-7a5daadb1650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:55.666158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-454148e4-61f8-4b7c-9265-7a5daadb1650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:55.785418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454148e4-61f8-4b7c-9265-7a5daadb1650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:55.786783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454148e4-61f8-4b7c-9265-7a5daadb1650 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:55.797297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:55.806055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 671/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:23:57.850422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69703-56f6-4d94-b32d-bca9bf12fb9a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:57.851244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69703-56f6-4d94-b32d-bca9bf12fb9a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:57.851347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69703-56f6-4d94-b32d-bca9bf12fb9a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:57.854777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 664/1335] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:23:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:23:57.861998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188713-9e12-4a17-bd0a-c01cb58bd4ae None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:57.862715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188713-9e12-4a17-bd0a-c01cb58bd4ae None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:57.862905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188713-9e12-4a17-bd0a-c01cb58bd4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:57.939275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bb188713-9e12-4a17-bd0a-c01cb58bd4ae None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:23:57.940515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bb188713-9e12-4a17-bd0a-c01cb58bd4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:58.051397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 672/1336] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:23:58.094008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69703-56f6-4d94-b32d-bca9bf12fb9a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:23:58.095551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2ea69703-56f6-4d94-b32d-bca9bf12fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:58.138261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:58.214156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69703-56f6-4d94-b32d-bca9bf12fb9a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:23:58.303346 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5c11-562b-4459-b14a-585c35bbee1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:23:58.303978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5c11-562b-4459-b14a-585c35bbee1a service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:23:58.304257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5c11-562b-4459-b14a-585c35bbee1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:23:58.304533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5c11-562b-4459-b14a-585c35bbee1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:23:58.306220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-892f5c11-562b-4459-b14a-585c35bbee1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:23:58.392911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:23:58.426701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5c11-562b-4459-b14a-585c35bbee1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:23:58.428151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5c11-562b-4459-b14a-585c35bbee1a service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:23:58.446683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 665/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:00.752730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7929-af34-4927-b50d-ca55222e9313 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:00.753643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7929-af34-4927-b50d-ca55222e9313 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:00.753643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7929-af34-4927-b50d-ca55222e9313 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:00.755837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 673/1338] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:00.764655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a628fd3-0e3c-4871-829a-ff142c6233de None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:00.765087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a628fd3-0e3c-4871-829a-ff142c6233de None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:00.765328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a628fd3-0e3c-4871-829a-ff142c6233de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:00.847806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0a628fd3-0e3c-4871-829a-ff142c6233de None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:00.849016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0a628fd3-0e3c-4871-829a-ff142c6233de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:00.954820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 666/1339] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:00.991253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7929-af34-4927-b50d-ca55222e9313 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:00.992793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ad4d7929-af34-4927-b50d-ca55222e9313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:01.083544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:01.114682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7929-af34-4927-b50d-ca55222e9313 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:01.208789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168091ed-f074-44c8-8fb2-681486cf3931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:01.209453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168091ed-f074-44c8-8fb2-681486cf3931 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:01.209708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168091ed-f074-44c8-8fb2-681486cf3931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:01.209996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168091ed-f074-44c8-8fb2-681486cf3931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:01.211640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-168091ed-f074-44c8-8fb2-681486cf3931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:01.326532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168091ed-f074-44c8-8fb2-681486cf3931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:01.327974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168091ed-f074-44c8-8fb2-681486cf3931 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:01.346351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 674/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:05.298406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675839-c4f2-4bbb-befe-0a7d64dadd95 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:05.298968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675839-c4f2-4bbb-befe-0a7d64dadd95 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:05.298968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675839-c4f2-4bbb-befe-0a7d64dadd95 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:05.300482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 667/1341] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:05.306149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45f80-6a60-4eb6-8eb6-057041f54f64 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:05.306149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45f80-6a60-4eb6-8eb6-057041f54f64 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:05.306731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45f80-6a60-4eb6-8eb6-057041f54f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:05.312423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:05.376186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-78f45f80-6a60-4eb6-8eb6-057041f54f64 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:05.377365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-78f45f80-6a60-4eb6-8eb6-057041f54f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:05.476265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 675/1342] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:05.515608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675839-c4f2-4bbb-befe-0a7d64dadd95 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:05.517938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-19675839-c4f2-4bbb-befe-0a7d64dadd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:05.567799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:05.627769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675839-c4f2-4bbb-befe-0a7d64dadd95 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:05.706922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072e84f-d545-466e-83c3-9186db7ce790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:05.707553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072e84f-d545-466e-83c3-9186db7ce790 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:05.708219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072e84f-d545-466e-83c3-9186db7ce790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:05.708489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072e84f-d545-466e-83c3-9186db7ce790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:05.710273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2072e84f-d545-466e-83c3-9186db7ce790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:05.810833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:05.829163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072e84f-d545-466e-83c3-9186db7ce790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:05.830665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072e84f-d545-466e-83c3-9186db7ce790 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:05.850676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 668/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:08.482406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b83c-e578-45b9-8c92-87a1ea19e26c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:08.482966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b83c-e578-45b9-8c92-87a1ea19e26c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:08.483048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b83c-e578-45b9-8c92-87a1ea19e26c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:08.484411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 676/1344] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:08.490306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7586c5-24dc-4788-91ab-e694b9e095e6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:08.490990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7586c5-24dc-4788-91ab-e694b9e095e6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:08.490990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7586c5-24dc-4788-91ab-e694b9e095e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:08.561502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ab7586c5-24dc-4788-91ab-e694b9e095e6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:08.562739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ab7586c5-24dc-4788-91ab-e694b9e095e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:08.665382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 669/1345] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:08.702873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143b83c-e578-45b9-8c92-87a1ea19e26c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:08.704438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4143b83c-e578-45b9-8c92-87a1ea19e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:08.796700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:08.814478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143b83c-e578-45b9-8c92-87a1ea19e26c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:08.892351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526af28b-cbd9-4c07-9cac-3e4f15178b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:08.892987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526af28b-cbd9-4c07-9cac-3e4f15178b31 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:08.893273 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526af28b-cbd9-4c07-9cac-3e4f15178b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:08.893591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526af28b-cbd9-4c07-9cac-3e4f15178b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:08.895233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-526af28b-cbd9-4c07-9cac-3e4f15178b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:09.011638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526af28b-cbd9-4c07-9cac-3e4f15178b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:09.013095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526af28b-cbd9-4c07-9cac-3e4f15178b31 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:09.033058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 677/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:12.963013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1560-13c3-4244-950d-f5651bcdcf5c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:12.963563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1560-13c3-4244-950d-f5651bcdcf5c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:12.963563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1560-13c3-4244-950d-f5651bcdcf5c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:12.964933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 670/1347] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:12.970605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb38ca-e505-48c1-b677-b1b4b5aa1055 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:12.971038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb38ca-e505-48c1-b677-b1b4b5aa1055 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:12.971168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb38ca-e505-48c1-b677-b1b4b5aa1055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:12.987270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:13.044054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-21bb38ca-e505-48c1-b677-b1b4b5aa1055 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:13.045396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-21bb38ca-e505-48c1-b677-b1b4b5aa1055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:13.166060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 678/1348] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:13.204524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1560-13c3-4244-950d-f5651bcdcf5c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:13.206556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f84e1560-13c3-4244-950d-f5651bcdcf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:13.273503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:13.321782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1560-13c3-4244-950d-f5651bcdcf5c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:13.398670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4898d3-57a5-4044-9414-fdc411c8f004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:13.399311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4898d3-57a5-4044-9414-fdc411c8f004 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:13.399594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4898d3-57a5-4044-9414-fdc411c8f004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:13.399869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4898d3-57a5-4044-9414-fdc411c8f004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:13.401563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9b4898d3-57a5-4044-9414-fdc411c8f004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:13.513792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:13.517139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4898d3-57a5-4044-9414-fdc411c8f004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:13.518994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4898d3-57a5-4044-9414-fdc411c8f004 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:13.538227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 671/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:18.340335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d3f1-51ae-4f51-83f1-1b4fc998ddde None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:18.341194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d3f1-51ae-4f51-83f1-1b4fc998ddde None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:18.341675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d3f1-51ae-4f51-83f1-1b4fc998ddde None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:18.343463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 679/1350] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:18.348507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9dfdd-627f-4810-8a7b-d5037a1c50f6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:18.349312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9dfdd-627f-4810-8a7b-d5037a1c50f6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:18.349750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9dfdd-627f-4810-8a7b-d5037a1c50f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:18.487743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e0d9dfdd-627f-4810-8a7b-d5037a1c50f6 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:18.489403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e0d9dfdd-627f-4810-8a7b-d5037a1c50f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:18.609641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 672/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:24:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:22.651836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6037c-d3de-4b13-afad-441b46341b51 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:22.652447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6037c-d3de-4b13-afad-441b46341b51 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:22.652447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6037c-d3de-4b13-afad-441b46341b51 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:22.654081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 680/1352] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:22.659073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c2411-698c-487a-b2cf-29fee8a1b497 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:22.659513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c2411-698c-487a-b2cf-29fee8a1b497 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:22.659610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c2411-698c-487a-b2cf-29fee8a1b497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:22.714566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:22.740172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ef5c2411-698c-487a-b2cf-29fee8a1b497 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:22.741414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ef5c2411-698c-487a-b2cf-29fee8a1b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:22.859640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 673/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:24:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:23.163718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=59 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:24.265059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139fdea-de04-4bb8-abfb-7e0b62966784 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:24.265710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139fdea-de04-4bb8-abfb-7e0b62966784 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:24.265710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139fdea-de04-4bb8-abfb-7e0b62966784 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:24.267327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 681/1354] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:24.272365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701314d8-9034-470d-906c-96580344a339 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:24.272792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701314d8-9034-470d-906c-96580344a339 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:24.272891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701314d8-9034-470d-906c-96580344a339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:24.352405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-701314d8-9034-470d-906c-96580344a339 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:24.353586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-701314d8-9034-470d-906c-96580344a339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:24.397492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:24.470666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 674/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:24:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:27.691556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392243d-1080-48c8-a7e8-6b9e09a62ea6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:27.692397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392243d-1080-48c8-a7e8-6b9e09a62ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:27.692885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392243d-1080-48c8-a7e8-6b9e09a62ea6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:27.694787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 682/1356] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:27.700536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7bd6-ecd8-4188-a45b-69e0f1cfbaa9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:27.701483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7bd6-ecd8-4188-a45b-69e0f1cfbaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:27.701991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7bd6-ecd8-4188-a45b-69e0f1cfbaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:27.785412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a63c7bd6-ecd8-4188-a45b-69e0f1cfbaa9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:27.786660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a63c7bd6-ecd8-4188-a45b-69e0f1cfbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:27.888190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 675/1357] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:27.940707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb27f48-0b2c-4824-9daf-dd06740da2d6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:27.940888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb27f48-0b2c-4824-9daf-dd06740da2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:27.941409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb27f48-0b2c-4824-9daf-dd06740da2d6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:27.942750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 683/1358] 10.222.0.47 () {54 vars in 962 bytes} [Fri Jul 29 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:27.952704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8890-a505-416a-8d59-4c432b5a68ee None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:27.953420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8890-a505-416a-8d59-4c432b5a68ee None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:27.953850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8890-a505-416a-8d59-4c432b5a68ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:27.974706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:28.038273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6dde8890-a505-416a-8d59-4c432b5a68ee None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:28.039456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6dde8890-a505-416a-8d59-4c432b5a68ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:28.162049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 676/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Fri Jul 29 08:24:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:28.170053 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb27f48-0b2c-4824-9daf-dd06740da2d6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:28.171558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3fb27f48-0b2c-4824-9daf-dd06740da2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:28.325665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb27f48-0b2c-4824-9daf-dd06740da2d6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:28.401258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:28.456667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13ae0-eda7-4d8c-a893-1137dceb89ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:28.457751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13ae0-eda7-4d8c-a893-1137dceb89ee service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:28.458155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13ae0-eda7-4d8c-a893-1137dceb89ee service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:28.458526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13ae0-eda7-4d8c-a893-1137dceb89ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:28.460272 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1ff13ae0-eda7-4d8c-a893-1137dceb89ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:28.552757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13ae0-eda7-4d8c-a893-1137dceb89ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:28.554534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13ae0-eda7-4d8c-a893-1137dceb89ee service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:28.573303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 684/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:30.777203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902742d-86aa-4a0a-a1f3-479747462dd3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:30.777819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902742d-86aa-4a0a-a1f3-479747462dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:30.778180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902742d-86aa-4a0a-a1f3-479747462dd3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:30.779963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 677/1361] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:30.785593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28d2b-dc38-460e-b9af-0024ab374270 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:30.786098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28d2b-dc38-460e-b9af-0024ab374270 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:30.786098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28d2b-dc38-460e-b9af-0024ab374270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:30.855742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1ab28d2b-dc38-460e-b9af-0024ab374270 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:30.856999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1ab28d2b-dc38-460e-b9af-0024ab374270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:30.897164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:30.968574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 685/1362] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:31.011706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902742d-86aa-4a0a-a1f3-479747462dd3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:31.013266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6902742d-86aa-4a0a-a1f3-479747462dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:31.097111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:31.184885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902742d-86aa-4a0a-a1f3-479747462dd3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:31.312267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fda4f-72e6-4810-9e24-c6bb4c3c549d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:31.312902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fda4f-72e6-4810-9e24-c6bb4c3c549d service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:31.313181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fda4f-72e6-4810-9e24-c6bb4c3c549d service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:31.313484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fda4f-72e6-4810-9e24-c6bb4c3c549d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:31.315171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-649fda4f-72e6-4810-9e24-c6bb4c3c549d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:31.342729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:31.427222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fda4f-72e6-4810-9e24-c6bb4c3c549d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:31.428870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fda4f-72e6-4810-9e24-c6bb4c3c549d service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:31.449443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 678/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:33.764563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1547159-085d-477c-b20b-b43314647554 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:33.765146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1547159-085d-477c-b20b-b43314647554 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:33.765146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1547159-085d-477c-b20b-b43314647554 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:33.766506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 686/1364] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:33.772012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48c30-ba34-436b-8e76-6bd9cfca5070 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:33.772472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48c30-ba34-436b-8e76-6bd9cfca5070 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:33.772576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48c30-ba34-436b-8e76-6bd9cfca5070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:33.853624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f7a48c30-ba34-436b-8e76-6bd9cfca5070 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:33.854866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f7a48c30-ba34-436b-8e76-6bd9cfca5070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:33.955982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:33.959270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 679/1365] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:34.004291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c5972-6956-4ae0-b1f7-77985052a64a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:34.004806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c5972-6956-4ae0-b1f7-77985052a64a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:34.005189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c5972-6956-4ae0-b1f7-77985052a64a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:34.006690 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 687/1366] 10.222.0.47 () {54 vars in 962 bytes} [Fri Jul 29 08:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:34.011953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2b0d6-99b2-4488-a9cb-328e143566c7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:34.012265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2b0d6-99b2-4488-a9cb-328e143566c7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:34.012554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2b0d6-99b2-4488-a9cb-328e143566c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:34.094507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0ec2b0d6-99b2-4488-a9cb-328e143566c7 None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:34.095943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0ec2b0d6-99b2-4488-a9cb-328e143566c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:34.227025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c5972-6956-4ae0-b1f7-77985052a64a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:34.228590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d00c5972-6956-4ae0-b1f7-77985052a64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:34.231500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 680/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Fri Jul 29 08:24:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:34.385759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c5972-6956-4ae0-b1f7-77985052a64a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:34.406473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:34.504874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a449a-81f1-43bf-81bb-d85c6f2f9067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:34.505439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a449a-81f1-43bf-81bb-d85c6f2f9067 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:34.505743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a449a-81f1-43bf-81bb-d85c6f2f9067 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:34.506022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a449a-81f1-43bf-81bb-d85c6f2f9067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:34.507656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5f1a449a-81f1-43bf-81bb-d85c6f2f9067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:34.598160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a449a-81f1-43bf-81bb-d85c6f2f9067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:34.599788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a449a-81f1-43bf-81bb-d85c6f2f9067 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:34.618337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 688/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:35.603022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd779-8e23-4781-abb0-7458c992ba03 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:35.604002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd779-8e23-4781-abb0-7458c992ba03 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:35.604283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd779-8e23-4781-abb0-7458c992ba03 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:35.605725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 681/1369] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:35.611171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a3bbc-ada3-4a8d-bfd8-ab229d473742 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:35.611590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a3bbc-ada3-4a8d-bfd8-ab229d473742 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:35.611765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a3bbc-ada3-4a8d-bfd8-ab229d473742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:35.644199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:35.680273 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-349a3bbc-ada3-4a8d-bfd8-ab229d473742 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:35.681485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-349a3bbc-ada3-4a8d-bfd8-ab229d473742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:35.787002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 689/1370] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:36.124313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912dea6-67e3-4d2b-b784-ba0b01b113a5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:36.124313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912dea6-67e3-4d2b-b784-ba0b01b113a5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:36.124313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912dea6-67e3-4d2b-b784-ba0b01b113a5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:36.127243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 682/1371] 10.222.0.47 () {54 vars in 964 bytes} [Fri Jul 29 08:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:36.130472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec97603-0dd7-44d7-a8de-2c9e933d992e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:36.130712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec97603-0dd7-44d7-a8de-2c9e933d992e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:36.131026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec97603-0dd7-44d7-a8de-2c9e933d992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:36.209719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8ec97603-0dd7-44d7-a8de-2c9e933d992e None None] MFA Rules not processed for user `8436207924e742caafdc816b373fd40b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:36.210903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8ec97603-0dd7-44d7-a8de-2c9e933d992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:36.267523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:36.299012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 690/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Fri Jul 29 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:36.307008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912dea6-67e3-4d2b-b784-ba0b01b113a5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:36.308718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8912dea6-67e3-4d2b-b784-ba0b01b113a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:36.362094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:36.417764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912dea6-67e3-4d2b-b784-ba0b01b113a5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:36.534217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dea8fc-4a79-4732-945d-2d55617175a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:36.534798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea8fc-4a79-4732-945d-2d55617175a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:36.535200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea8fc-4a79-4732-945d-2d55617175a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:36.535484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea8fc-4a79-4732-945d-2d55617175a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:36.537317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b7dea8fc-4a79-4732-945d-2d55617175a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:36.638660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:36.652743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dea8fc-4a79-4732-945d-2d55617175a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:36.654252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dea8fc-4a79-4732-945d-2d55617175a0 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:36.681439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 683/1373] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:36.728643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f28d-e1dc-4bd9-b137-5921a280a761 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:36.729955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f28d-e1dc-4bd9-b137-5921a280a761 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:36.730190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f28d-e1dc-4bd9-b137-5921a280a761 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:36.732041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 691/1374] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:36.737312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7818-60a9-4d62-8684-cc6a6b2cee2b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:36.737539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7818-60a9-4d62-8684-cc6a6b2cee2b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:36.737871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7818-60a9-4d62-8684-cc6a6b2cee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:36.806785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2bcf7818-60a9-4d62-8684-cc6a6b2cee2b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:36.807887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2bcf7818-60a9-4d62-8684-cc6a6b2cee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:36.916579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 684/1375] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:36.962390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f28d-e1dc-4bd9-b137-5921a280a761 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:36.963920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a941f28d-e1dc-4bd9-b137-5921a280a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:37.120215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f28d-e1dc-4bd9-b137-5921a280a761 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:37.175491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:37.245361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655619b-02be-4ce2-bf15-bd94b505cdc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:37.246354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655619b-02be-4ce2-bf15-bd94b505cdc1 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:37.246643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655619b-02be-4ce2-bf15-bd94b505cdc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:37.246922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655619b-02be-4ce2-bf15-bd94b505cdc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:37.250665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4655619b-02be-4ce2-bf15-bd94b505cdc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:37.345930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655619b-02be-4ce2-bf15-bd94b505cdc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:37.347555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655619b-02be-4ce2-bf15-bd94b505cdc1 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:37.366215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 692/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:39.420714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfeead-f63e-4f08-8364-7761a3ba5719 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:39.421318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfeead-f63e-4f08-8364-7761a3ba5719 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:39.421318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfeead-f63e-4f08-8364-7761a3ba5719 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:39.422692 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 685/1377] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:39.427930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26269799-d4db-4ded-a82c-d42d2d61ea34 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:39.428351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26269799-d4db-4ded-a82c-d42d2d61ea34 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:39.428440 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26269799-d4db-4ded-a82c-d42d2d61ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:39.498452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-26269799-d4db-4ded-a82c-d42d2d61ea34 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:39.499707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-26269799-d4db-4ded-a82c-d42d2d61ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:39.512137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:39.609056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 693/1378] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:39.654109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfeead-f63e-4f08-8364-7761a3ba5719 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:39.656208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b6cfeead-f63e-4f08-8364-7761a3ba5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:39.735340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:39.826249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfeead-f63e-4f08-8364-7761a3ba5719 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:39.941868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ffa8f-05e6-4abd-9661-10afbe8afd19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:39.942609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ffa8f-05e6-4abd-9661-10afbe8afd19 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:39.942971 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ffa8f-05e6-4abd-9661-10afbe8afd19 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:39.943310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ffa8f-05e6-4abd-9661-10afbe8afd19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:39.945004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7e1ffa8f-05e6-4abd-9661-10afbe8afd19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:39.963905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:40.050740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ffa8f-05e6-4abd-9661-10afbe8afd19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:40.052489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ffa8f-05e6-4abd-9661-10afbe8afd19 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:40.071731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 686/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:42.134282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d177-46a5-40a7-be85-db7088d0ac84 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:42.134894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d177-46a5-40a7-be85-db7088d0ac84 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:42.134894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d177-46a5-40a7-be85-db7088d0ac84 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:42.136468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 694/1380] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:42.142223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911caa83-9e32-4f2f-92dd-02675ff3b26b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:42.142802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911caa83-9e32-4f2f-92dd-02675ff3b26b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:42.142802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911caa83-9e32-4f2f-92dd-02675ff3b26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:42.220060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-911caa83-9e32-4f2f-92dd-02675ff3b26b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:42.221309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-911caa83-9e32-4f2f-92dd-02675ff3b26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:42.327159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:42.340816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 687/1381] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:42.378039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d177-46a5-40a7-be85-db7088d0ac84 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:42.379840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9c47d177-46a5-40a7-be85-db7088d0ac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:42.535590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:42.548570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d177-46a5-40a7-be85-db7088d0ac84 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:42.667778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac71c9-ccb5-41fc-befa-dc2a750dd0b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:42.668434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac71c9-ccb5-41fc-befa-dc2a750dd0b2 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:42.668713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac71c9-ccb5-41fc-befa-dc2a750dd0b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:42.668984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac71c9-ccb5-41fc-befa-dc2a750dd0b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:42.670618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f3ac71c9-ccb5-41fc-befa-dc2a750dd0b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:42.766510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac71c9-ccb5-41fc-befa-dc2a750dd0b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:42.768150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac71c9-ccb5-41fc-befa-dc2a750dd0b2 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:42.779225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:42.789003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 695/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:44.843243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4849be-5b0a-4572-85fc-4a023e0e839d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:44.843863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4849be-5b0a-4572-85fc-4a023e0e839d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:44.844226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4849be-5b0a-4572-85fc-4a023e0e839d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:44.846198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 688/1383] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:44.854170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737d99-184c-4cb9-8c52-7544e74f04fc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:44.854778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737d99-184c-4cb9-8c52-7544e74f04fc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:44.854778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737d99-184c-4cb9-8c52-7544e74f04fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:44.948264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-18737d99-184c-4cb9-8c52-7544e74f04fc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:44.949588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-18737d99-184c-4cb9-8c52-7544e74f04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:45.066947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 696/1384] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:45.130456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4849be-5b0a-4572-85fc-4a023e0e839d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:45.133408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9b4849be-5b0a-4572-85fc-4a023e0e839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:45.324345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4849be-5b0a-4572-85fc-4a023e0e839d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:45.401552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:45.447956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495359e-4a77-41f0-ba9c-fe39f3dd34ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:45.448605 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495359e-4a77-41f0-ba9c-fe39f3dd34ac service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:45.448889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495359e-4a77-41f0-ba9c-fe39f3dd34ac service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:45.449173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495359e-4a77-41f0-ba9c-fe39f3dd34ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:45.450901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5495359e-4a77-41f0-ba9c-fe39f3dd34ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:45.554334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495359e-4a77-41f0-ba9c-fe39f3dd34ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:45.556739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495359e-4a77-41f0-ba9c-fe39f3dd34ac service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:45.582341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 689/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:47.612258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b3dc2-9c3d-43ed-8881-847f009759ee None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:47.613029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b3dc2-9c3d-43ed-8881-847f009759ee None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:47.613029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b3dc2-9c3d-43ed-8881-847f009759ee None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:47.614549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 697/1386] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:47.621014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede08e8-a134-467a-bc7d-141ec4b552cb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:47.621642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede08e8-a134-467a-bc7d-141ec4b552cb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:47.621642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede08e8-a134-467a-bc7d-141ec4b552cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:47.694834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0ede08e8-a134-467a-bc7d-141ec4b552cb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:47.696010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0ede08e8-a134-467a-bc7d-141ec4b552cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:47.736079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:47.812367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 690/1387] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:47.860430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b3dc2-9c3d-43ed-8881-847f009759ee None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:47.862001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ab2b3dc2-9c3d-43ed-8881-847f009759ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:47.960228 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:48.056303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b3dc2-9c3d-43ed-8881-847f009759ee None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:48.189944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640ca91-4811-421c-8a82-eb18e986c64b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:48.190602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640ca91-4811-421c-8a82-eb18e986c64b service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:48.190882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640ca91-4811-421c-8a82-eb18e986c64b service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:48.191165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640ca91-4811-421c-8a82-eb18e986c64b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:48.192884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5640ca91-4811-421c-8a82-eb18e986c64b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:48.233018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:48.287607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640ca91-4811-421c-8a82-eb18e986c64b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:48.289303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640ca91-4811-421c-8a82-eb18e986c64b service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:48.308323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 698/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:50.357227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5e97-c603-47d1-bfd2-a0691d294965 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:50.357800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5e97-c603-47d1-bfd2-a0691d294965 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:50.357800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5e97-c603-47d1-bfd2-a0691d294965 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:50.359160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 691/1389] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:50.364550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4347-7dab-4d1b-975b-b73aec6f38b4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:50.364946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4347-7dab-4d1b-975b-b73aec6f38b4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:50.365104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4347-7dab-4d1b-975b-b73aec6f38b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:50.431692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b4ba4347-7dab-4d1b-975b-b73aec6f38b4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:50.432902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b4ba4347-7dab-4d1b-975b-b73aec6f38b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:50.529255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 699/1390] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:50.573043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe5e97-c603-47d1-bfd2-a0691d294965 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:50.574789 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b8fe5e97-c603-47d1-bfd2-a0691d294965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:50.728368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe5e97-c603-47d1-bfd2-a0691d294965 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:50.745044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:50.842915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b527-ff47-4734-a31e-012f7553f326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:50.843534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b527-ff47-4734-a31e-012f7553f326 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:50.843874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b527-ff47-4734-a31e-012f7553f326 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:50.844147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b527-ff47-4734-a31e-012f7553f326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:50.845784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-10e7b527-ff47-4734-a31e-012f7553f326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:50.934825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7b527-ff47-4734-a31e-012f7553f326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:50.936488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7b527-ff47-4734-a31e-012f7553f326 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:50.956374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 692/1391] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:51.595865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fa25-e036-43f2-b9ae-584415397fd6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:51.596434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fa25-e036-43f2-b9ae-584415397fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:51.596434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fa25-e036-43f2-b9ae-584415397fd6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:51.598030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 700/1392] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:51.603624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27249-467c-4d57-93da-156da74c138a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:51.604110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27249-467c-4d57-93da-156da74c138a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:51.604204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27249-467c-4d57-93da-156da74c138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:51.631546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:51.674038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-89a27249-467c-4d57-93da-156da74c138a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:51.675248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89a27249-467c-4d57-93da-156da74c138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:51.780262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 693/1393] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:51.836184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa8e4-22c4-4cb7-8250-bea7ff46713e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:51.836476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa8e4-22c4-4cb7-8250-bea7ff46713e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:51.836762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa8e4-22c4-4cb7-8250-bea7ff46713e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:51.838134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 701/1394] 10.222.0.47 () {54 vars in 966 bytes} [Fri Jul 29 08:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:51.843488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ffead-81d9-4b5c-9524-b9e9bde70e71 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:51.843775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ffead-81d9-4b5c-9524-b9e9bde70e71 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:51.844053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ffead-81d9-4b5c-9524-b9e9bde70e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:51.923499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b80ffead-81d9-4b5c-9524-b9e9bde70e71 None None] MFA Rules not processed for user `fb625a81268d4067a59dbd34de4019cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:51.924622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b80ffead-81d9-4b5c-9524-b9e9bde70e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:51.967445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:52.004311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 694/1395] 10.222.0.47 () {58 vars in 1063 bytes} [Fri Jul 29 08:24:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:52.012291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfa8e4-22c4-4cb7-8250-bea7ff46713e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:52.013880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8bbfa8e4-22c4-4cb7-8250-bea7ff46713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:52.028098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:52.123460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfa8e4-22c4-4cb7-8250-bea7ff46713e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:52.200923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceee99-6d37-4e98-8ea3-37882327f70f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:52.201502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceee99-6d37-4e98-8ea3-37882327f70f service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:52.201781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceee99-6d37-4e98-8ea3-37882327f70f service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:52.202056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceee99-6d37-4e98-8ea3-37882327f70f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:52.203705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-beceee99-6d37-4e98-8ea3-37882327f70f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:52.286664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:52.328353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beceee99-6d37-4e98-8ea3-37882327f70f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:52.329822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beceee99-6d37-4e98-8ea3-37882327f70f service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:52.348144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 702/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:53.006209 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ee4a-be6b-486b-baa3-7df7d9920bee None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:53.006799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ee4a-be6b-486b-baa3-7df7d9920bee None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:53.006799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ee4a-be6b-486b-baa3-7df7d9920bee None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:53.008184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 695/1397] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:53.014234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:53.014755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:53.014855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:53.085639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a583d-4f28-43d6-bf70-9f375ec22b07 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:53.085928 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a583d-4f28-43d6-bf70-9f375ec22b07 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:53.086211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a583d-4f28-43d6-bf70-9f375ec22b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:53.087594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:53.088815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:53.155937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6a7a583d-4f28-43d6-bf70-9f375ec22b07 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:53.157207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6a7a583d-4f28-43d6-bf70-9f375ec22b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:53.186356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 703/1398] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:53.231508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:53.232758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:53.261616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 696/1399] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:24:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:53.271322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:53.313190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527e29b-2dca-4726-99a4-0f8d0d7aa90a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:53.313515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527e29b-2dca-4726-99a4-0f8d0d7aa90a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:53.313815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527e29b-2dca-4726-99a4-0f8d0d7aa90a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:53.315181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 697/1400] 10.222.0.47 () {54 vars in 943 bytes} [Fri Jul 29 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:24:53.321087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd908ee-2462-4739-aac7-28d911398e73 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:53.321486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd908ee-2462-4739-aac7-28d911398e73 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:53.321756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd908ee-2462-4739-aac7-28d911398e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:53.364650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8d9a-19bf-46b2-a8f4-cada2ed97d08 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:53.391021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:53.399096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cbd908ee-2462-4739-aac7-28d911398e73 None None] MFA Rules not processed for user `e3ed5e24f863460ab8dea052bed1dac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:53.400383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cbd908ee-2462-4739-aac7-28d911398e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:53.479619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cfb53-4c6a-4796-9105-cbd3adc81729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:53.480281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cfb53-4c6a-4796-9105-cbd3adc81729 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:53.480673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cfb53-4c6a-4796-9105-cbd3adc81729 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:53.480950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cfb53-4c6a-4796-9105-cbd3adc81729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:53.482697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ce9cfb53-4c6a-4796-9105-cbd3adc81729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:53.501171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:53.511905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 698/1401] 10.222.0.47 () {58 vars in 1040 bytes} [Fri Jul 29 08:24:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:53.521240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd908ee-2462-4739-aac7-28d911398e73 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:53.530879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd908ee-2462-4739-aac7-28d911398e73 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:53.574873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cfb53-4c6a-4796-9105-cbd3adc81729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:53.576529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cfb53-4c6a-4796-9105-cbd3adc81729 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:53.595150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 704/1402] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:24:53.641442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6be24-0480-45c6-9b52-478734551052 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:53.642023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6be24-0480-45c6-9b52-478734551052 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:53.642304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6be24-0480-45c6-9b52-478734551052 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:53.642581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6be24-0480-45c6-9b52-478734551052 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:53.644246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c7f6be24-0480-45c6-9b52-478734551052 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:53.646910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:53.737994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6be24-0480-45c6-9b52-478734551052 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:53.739640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6be24-0480-45c6-9b52-478734551052 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:53.748885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 699/1403] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:24:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 29 08:24:55.619531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a8c5-b4c9-40ad-97c5-885129262cc3 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:55.620118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a8c5-b4c9-40ad-97c5-885129262cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:55.620118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a8c5-b4c9-40ad-97c5-885129262cc3 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:55.626153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 705/1404] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:55.627236 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187372b-3973-4830-a90a-76958a7433ab None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:55.627781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187372b-3973-4830-a90a-76958a7433ab None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:55.628027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187372b-3973-4830-a90a-76958a7433ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:55.703275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8187372b-3973-4830-a90a-76958a7433ab None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:55.704506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8187372b-3973-4830-a90a-76958a7433ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:55.807960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:55.815194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 700/1405] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:24:55.859479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283a8c5-b4c9-40ad-97c5-885129262cc3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:55.862674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2283a8c5-b4c9-40ad-97c5-885129262cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:56.048429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:56.051629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283a8c5-b4c9-40ad-97c5-885129262cc3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:56.186776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1504-d611-4420-831b-4600c1c0063d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:56.187436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1504-d611-4420-831b-4600c1c0063d service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:56.187723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1504-d611-4420-831b-4600c1c0063d service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:56.188001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1504-d611-4420-831b-4600c1c0063d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:56.189691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8faa1504-d611-4420-831b-4600c1c0063d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:56.298022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1504-d611-4420-831b-4600c1c0063d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:56.299687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1504-d611-4420-831b-4600c1c0063d service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:56.319742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 706/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:24:58.357601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3eb9-a298-4b26-b1cd-a920f9101bdc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:58.358196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3eb9-a298-4b26-b1cd-a920f9101bdc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:58.358196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3eb9-a298-4b26-b1cd-a920f9101bdc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:58.359454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 701/1407] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:24:58.364616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1cf46-2fff-4a79-a23a-ac1cf15c70dd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:58.365043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1cf46-2fff-4a79-a23a-ac1cf15c70dd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:58.365217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1cf46-2fff-4a79-a23a-ac1cf15c70dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:58.370261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:58.441729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-14e1cf46-2fff-4a79-a23a-ac1cf15c70dd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:24:58.442971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-14e1cf46-2fff-4a79-a23a-ac1cf15c70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:58.545301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 707/1408] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:24:58.591181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3eb9-a298-4b26-b1cd-a920f9101bdc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:24:58.592734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8ebd3eb9-a298-4b26-b1cd-a920f9101bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:58.763392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3eb9-a298-4b26-b1cd-a920f9101bdc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:24:58.839906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:58.892539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f445a15-dc5b-467c-a877-dce73af4248f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:24:58.893375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f445a15-dc5b-467c-a877-dce73af4248f service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:24:58.893725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f445a15-dc5b-467c-a877-dce73af4248f service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:24:58.894081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f445a15-dc5b-467c-a877-dce73af4248f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:24:58.895804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7f445a15-dc5b-467c-a877-dce73af4248f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:24:58.996496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f445a15-dc5b-467c-a877-dce73af4248f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:24:58.998134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f445a15-dc5b-467c-a877-dce73af4248f service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:24:59.018896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 702/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:08.543487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=64 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:09.016280 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=64 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:15.502303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa4066-4b14-4956-89ee-da12f3af23a6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:15.502854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa4066-4b14-4956-89ee-da12f3af23a6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:15.502854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa4066-4b14-4956-89ee-da12f3af23a6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:15.504318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 708/1410] 10.222.0.47 () {54 vars in 918 bytes} [Fri Jul 29 08:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:15.509894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319f3e-0fd5-4be6-b731-d17796b08420 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:15.510314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319f3e-0fd5-4be6-b731-d17796b08420 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:15.510541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319f3e-0fd5-4be6-b731-d17796b08420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:15.591573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c9319f3e-0fd5-4be6-b731-d17796b08420 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:15.592771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c9319f3e-0fd5-4be6-b731-d17796b08420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:15.700366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 703/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Fri Jul 29 08:25:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:15.715639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5faa9-ba01-4e49-a27f-eb1da1320483 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:15.715924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5faa9-ba01-4e49-a27f-eb1da1320483 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:15.716192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5faa9-ba01-4e49-a27f-eb1da1320483 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:15.717601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 709/1412] 10.222.0.47 () {54 vars in 918 bytes} [Fri Jul 29 08:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:15.722454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52e4b5-4f08-45b3-abbe-167d14df5b61 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:15.722723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52e4b5-4f08-45b3-abbe-167d14df5b61 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:15.723001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52e4b5-4f08-45b3-abbe-167d14df5b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:15.808050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:15.811545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8e52e4b5-4f08-45b3-abbe-167d14df5b61 None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:15.813665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8e52e4b5-4f08-45b3-abbe-167d14df5b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:15.938261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 704/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Fri Jul 29 08:25:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:18.386207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b4b1-8cd3-4e47-8bef-5e48ee7c75ab None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:18.386777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b4b1-8cd3-4e47-8bef-5e48ee7c75ab None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:18.386777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b4b1-8cd3-4e47-8bef-5e48ee7c75ab None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:18.388145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:18.394809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d6b6-ab2a-4c9f-a6a9-13178cbad3f4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:18.395242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d6b6-ab2a-4c9f-a6a9-13178cbad3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:18.395419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d6b6-ab2a-4c9f-a6a9-13178cbad3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:18.474155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2f04d6b6-ab2a-4c9f-a6a9-13178cbad3f4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:18.475396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2f04d6b6-ab2a-4c9f-a6a9-13178cbad3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:18.534309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:18.577763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:18.624452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b4b1-8cd3-4e47-8bef-5e48ee7c75ab None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:18.626059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4668b4b1-8cd3-4e47-8bef-5e48ee7c75ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:18.788906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b4b1-8cd3-4e47-8bef-5e48ee7c75ab None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:18.867860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:18.909892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560118db-fe03-4042-8631-1bb5ea21c3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:18.910522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560118db-fe03-4042-8631-1bb5ea21c3bd service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:18.910803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560118db-fe03-4042-8631-1bb5ea21c3bd service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:18.911082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560118db-fe03-4042-8631-1bb5ea21c3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:18.912707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-560118db-fe03-4042-8631-1bb5ea21c3bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:19.007379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560118db-fe03-4042-8631-1bb5ea21c3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:19.009787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560118db-fe03-4042-8631-1bb5ea21c3bd service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:19.034150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 711/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:19.939107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ca36-ec5c-4166-9d81-1b3d7b060569 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:19.939712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ca36-ec5c-4166-9d81-1b3d7b060569 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:19.939712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ca36-ec5c-4166-9d81-1b3d7b060569 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:19.941043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:19.947315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee93a2-8000-4af8-9459-68fbf1e9fb57 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:19.948065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee93a2-8000-4af8-9459-68fbf1e9fb57 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:19.948173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee93a2-8000-4af8-9459-68fbf1e9fb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:20.157483 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6eee93a2-8000-4af8-9459-68fbf1e9fb57 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:20.158699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6eee93a2-8000-4af8-9459-68fbf1e9fb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:20.187025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:20.262005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:20.414750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649ca36-ec5c-4166-9d81-1b3d7b060569 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:20.416193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8649ca36-ec5c-4166-9d81-1b3d7b060569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:20.570437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649ca36-ec5c-4166-9d81-1b3d7b060569 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:20.611245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:20.685966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3774b4-865b-4725-b73b-98bf876a1606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:20.686503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3774b4-865b-4725-b73b-98bf876a1606 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:20.686775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3774b4-865b-4725-b73b-98bf876a1606 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:20.687042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3774b4-865b-4725-b73b-98bf876a1606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:20.688661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4e3774b4-865b-4725-b73b-98bf876a1606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:20.778538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3774b4-865b-4725-b73b-98bf876a1606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:20.780151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3774b4-865b-4725-b73b-98bf876a1606 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:20.799471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 707/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:21.691031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abedc16-ba67-416f-9779-16024d7756d2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:21.691917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abedc16-ba67-416f-9779-16024d7756d2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:21.691917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abedc16-ba67-416f-9779-16024d7756d2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:21.694134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:21.700128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4195b-ede8-4979-a870-bd99ef9ec112 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:21.700585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4195b-ede8-4979-a870-bd99ef9ec112 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:21.700682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4195b-ede8-4979-a870-bd99ef9ec112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:21.761120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:21.784040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-27d4195b-ede8-4979-a870-bd99ef9ec112 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:21.785246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-27d4195b-ede8-4979-a870-bd99ef9ec112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:21.899131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:22.057675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abedc16-ba67-416f-9779-16024d7756d2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:22.059174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7abedc16-ba67-416f-9779-16024d7756d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:22.220687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abedc16-ba67-416f-9779-16024d7756d2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:22.236842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:22.344201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b527c-2948-489a-8f4a-1efee5da64b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:22.344831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b527c-2948-489a-8f4a-1efee5da64b3 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:22.345112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b527c-2948-489a-8f4a-1efee5da64b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:22.345418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b527c-2948-489a-8f4a-1efee5da64b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:22.347085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d41b527c-2948-489a-8f4a-1efee5da64b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:22.450017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b527c-2948-489a-8f4a-1efee5da64b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:22.450017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b527c-2948-489a-8f4a-1efee5da64b3 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:22.471696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 714/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:23.322947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ac17b-2d49-4f98-bcb9-638baa3fcbb3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:23.323545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ac17b-2d49-4f98-bcb9-638baa3fcbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:23.323545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ac17b-2d49-4f98-bcb9-638baa3fcbb3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:23.324881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:23.330039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2d12-d49c-4ddd-ac45-c06afdf1824b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:23.330527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2d12-d49c-4ddd-ac45-c06afdf1824b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:23.330642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2d12-d49c-4ddd-ac45-c06afdf1824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:23.350811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:23.410113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b9ef2d12-d49c-4ddd-ac45-c06afdf1824b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:23.411366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b9ef2d12-d49c-4ddd-ac45-c06afdf1824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:23.514691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:23.663945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ac17b-2d49-4f98-bcb9-638baa3fcbb3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:23.666359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-288ac17b-2d49-4f98-bcb9-638baa3fcbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:23.786974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:23.824645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ac17b-2d49-4f98-bcb9-638baa3fcbb3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:23.946785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb5844-b735-4c22-948e-9bace8bcb815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:23.947888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5844-b735-4c22-948e-9bace8bcb815 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:23.948162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5844-b735-4c22-948e-9bace8bcb815 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:23.948477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5844-b735-4c22-948e-9bace8bcb815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:23.950155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-39fb5844-b735-4c22-948e-9bace8bcb815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:24.033786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:24.049259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb5844-b735-4c22-948e-9bace8bcb815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:24.050881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb5844-b735-4c22-948e-9bace8bcb815 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:24.069411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 710/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:24.932285 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f7df-484d-4a15-9206-d52d3db4d45f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:24.933214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f7df-484d-4a15-9206-d52d3db4d45f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:24.933214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f7df-484d-4a15-9206-d52d3db4d45f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:24.935482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:24.941739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80de0-1117-481c-9344-120d61567cf0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:24.942217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80de0-1117-481c-9344-120d61567cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:24.942315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80de0-1117-481c-9344-120d61567cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:25.028239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-51b80de0-1117-481c-9344-120d61567cf0 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:25.029496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-51b80de0-1117-481c-9344-120d61567cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:25.129560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:25.279101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f7df-484d-4a15-9206-d52d3db4d45f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:25.281462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0f82f7df-484d-4a15-9206-d52d3db4d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:25.374168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:25.435430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f7df-484d-4a15-9206-d52d3db4d45f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:25.564708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6849789-ab03-41aa-9761-21f40602c909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:25.565248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6849789-ab03-41aa-9761-21f40602c909 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:25.565569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6849789-ab03-41aa-9761-21f40602c909 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:25.565845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6849789-ab03-41aa-9761-21f40602c909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:25.567505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b6849789-ab03-41aa-9761-21f40602c909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:25.620597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:25.670918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6849789-ab03-41aa-9761-21f40602c909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:25.672505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6849789-ab03-41aa-9761-21f40602c909 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:25.690832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 717/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:26.487874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945fb11-fa4a-472d-8985-0ecf359a9d71 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:26.488457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945fb11-fa4a-472d-8985-0ecf359a9d71 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:26.488457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945fb11-fa4a-472d-8985-0ecf359a9d71 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:26.489740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:26.495942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707227e0-67a7-4493-93d0-23e7cfd8a392 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:26.496633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707227e0-67a7-4493-93d0-23e7cfd8a392 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:26.496818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707227e0-67a7-4493-93d0-23e7cfd8a392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:26.576997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-707227e0-67a7-4493-93d0-23e7cfd8a392 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:26.578220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-707227e0-67a7-4493-93d0-23e7cfd8a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:26.679967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:26.837831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945fb11-fa4a-472d-8985-0ecf359a9d71 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:26.840338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5945fb11-fa4a-472d-8985-0ecf359a9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:26.899478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:27.013488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945fb11-fa4a-472d-8985-0ecf359a9d71 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:27.139250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8ba94-b184-453f-bb07-05f373465554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:27.139974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ba94-b184-453f-bb07-05f373465554 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:27.140258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ba94-b184-453f-bb07-05f373465554 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:27.140565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ba94-b184-453f-bb07-05f373465554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:27.143051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-54d8ba94-b184-453f-bb07-05f373465554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:27.153745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:27.244057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8ba94-b184-453f-bb07-05f373465554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:27.245734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8ba94-b184-453f-bb07-05f373465554 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:27.264415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 713/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:28.097116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108bef-47db-48db-9b0b-0ae4e45bee53 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:28.097866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108bef-47db-48db-9b0b-0ae4e45bee53 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:28.097866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108bef-47db-48db-9b0b-0ae4e45bee53 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:28.099064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:28.105401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66045-c05d-4203-8e01-91802bcbe410 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:28.106048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66045-c05d-4203-8e01-91802bcbe410 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:28.106151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66045-c05d-4203-8e01-91802bcbe410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:28.192691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-90e66045-c05d-4203-8e01-91802bcbe410 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:28.193947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-90e66045-c05d-4203-8e01-91802bcbe410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:28.267665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:28.429237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:28.582963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3108bef-47db-48db-9b0b-0ae4e45bee53 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:28.584493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3108bef-47db-48db-9b0b-0ae4e45bee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:28.606366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:28.751169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3108bef-47db-48db-9b0b-0ae4e45bee53 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:28.848869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:28.875637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ebef2-bb81-40f2-899b-ed56373bd527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:28.876253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ebef2-bb81-40f2-899b-ed56373bd527 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:28.876529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ebef2-bb81-40f2-899b-ed56373bd527 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:28.876800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ebef2-bb81-40f2-899b-ed56373bd527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:28.878458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-008ebef2-bb81-40f2-899b-ed56373bd527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:28.974891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ebef2-bb81-40f2-899b-ed56373bd527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:28.976501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ebef2-bb81-40f2-899b-ed56373bd527 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:29.005824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 720/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:29.813898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a834136-efcd-4ecc-8cd1-68d32c9a783e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:29.814516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a834136-efcd-4ecc-8cd1-68d32c9a783e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:29.814516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a834136-efcd-4ecc-8cd1-68d32c9a783e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:29.816662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:29.821488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ec09-95a1-4d20-830c-53bf63843c40 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:29.821925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ec09-95a1-4d20-830c-53bf63843c40 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:29.822048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ec09-95a1-4d20-830c-53bf63843c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:29.900500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e467ec09-95a1-4d20-830c-53bf63843c40 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:29.901773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e467ec09-95a1-4d20-830c-53bf63843c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:29.943892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:30.002546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:25:30.155344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a834136-efcd-4ecc-8cd1-68d32c9a783e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:30.157568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5a834136-efcd-4ecc-8cd1-68d32c9a783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:30.333917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a834136-efcd-4ecc-8cd1-68d32c9a783e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:30.393517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:30.454065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a333-5fe7-4664-9f88-ff5f95be302d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:30.454694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a333-5fe7-4664-9f88-ff5f95be302d service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:30.454969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a333-5fe7-4664-9f88-ff5f95be302d service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:30.455234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a333-5fe7-4664-9f88-ff5f95be302d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:30.457245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eca5a333-5fe7-4664-9f88-ff5f95be302d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:30.552404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5a333-5fe7-4664-9f88-ff5f95be302d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:30.554046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5a333-5fe7-4664-9f88-ff5f95be302d service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:30.576393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 716/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:31.376641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a664fc1-198f-4b1a-82b5-97caabc70d30 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:31.377330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a664fc1-198f-4b1a-82b5-97caabc70d30 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:31.377330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a664fc1-198f-4b1a-82b5-97caabc70d30 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:31.379546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:25:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:31.385466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ab6ca-3016-4239-bc60-55943c9ead17 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:31.385923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ab6ca-3016-4239-bc60-55943c9ead17 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:31.386012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ab6ca-3016-4239-bc60-55943c9ead17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:31.472886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cc4ab6ca-3016-4239-bc60-55943c9ead17 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:31.474121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc4ab6ca-3016-4239-bc60-55943c9ead17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:31.476135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:31.577757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:31.730419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a664fc1-198f-4b1a-82b5-97caabc70d30 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:31.732846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4a664fc1-198f-4b1a-82b5-97caabc70d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:31.890215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a664fc1-198f-4b1a-82b5-97caabc70d30 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:31.919759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:32.014320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600be01-1d31-4909-86e0-33fc7238ffdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:32.014990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600be01-1d31-4909-86e0-33fc7238ffdb service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:32.015271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600be01-1d31-4909-86e0-33fc7238ffdb service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:32.015546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600be01-1d31-4909-86e0-33fc7238ffdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:32.017203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4600be01-1d31-4909-86e0-33fc7238ffdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:32.116472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600be01-1d31-4909-86e0-33fc7238ffdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:32.118115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600be01-1d31-4909-86e0-33fc7238ffdb service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:32.137498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 723/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:34.025471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1636-f496-4d25-9364-6b092563c4cd None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:34.026311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1636-f496-4d25-9364-6b092563c4cd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:34.026311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1636-f496-4d25-9364-6b092563c4cd None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:34.028266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:34.033891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27c036-037f-49e0-a27e-fb4f2aa610ba None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:34.034369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27c036-037f-49e0-a27e-fb4f2aa610ba None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:34.034493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27c036-037f-49e0-a27e-fb4f2aa610ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:34.077625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:34.115202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8b27c036-037f-49e0-a27e-fb4f2aa610ba None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:34.116434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8b27c036-037f-49e0-a27e-fb4f2aa610ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:34.218947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:25:34.261640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b1636-f496-4d25-9364-6b092563c4cd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:34.263326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8b0b1636-f496-4d25-9364-6b092563c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:34.376415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b1636-f496-4d25-9364-6b092563c4cd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:34.410198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:34.459499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6b525-e1c4-4f3f-bf47-8ce2c872c00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:34.460124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b525-e1c4-4f3f-bf47-8ce2c872c00e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:34.460401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b525-e1c4-4f3f-bf47-8ce2c872c00e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:34.460667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b525-e1c4-4f3f-bf47-8ce2c872c00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:34.462311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83c6b525-e1c4-4f3f-bf47-8ce2c872c00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:34.582973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6b525-e1c4-4f3f-bf47-8ce2c872c00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:34.584417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6b525-e1c4-4f3f-bf47-8ce2c872c00e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:34.603904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 719/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:36.780532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773573e7-beb2-44ea-8f83-fcfb3cd773c3 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:36.781528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773573e7-beb2-44ea-8f83-fcfb3cd773c3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:36.781528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773573e7-beb2-44ea-8f83-fcfb3cd773c3 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:36.783697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:36.792606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd481e8-776c-48d4-9be6-37a5ceae1d94 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:36.793051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd481e8-776c-48d4-9be6-37a5ceae1d94 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:36.793202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd481e8-776c-48d4-9be6-37a5ceae1d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:36.865807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6cd481e8-776c-48d4-9be6-37a5ceae1d94 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:36.867038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6cd481e8-776c-48d4-9be6-37a5ceae1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:36.880654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:36.971349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:37.021139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773573e7-beb2-44ea-8f83-fcfb3cd773c3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:37.023602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-773573e7-beb2-44ea-8f83-fcfb3cd773c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:37.152257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773573e7-beb2-44ea-8f83-fcfb3cd773c3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:37.165872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:37.229766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9075-6489-448a-a997-a6f6244113f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:37.230394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9075-6489-448a-a997-a6f6244113f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:37.230753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9075-6489-448a-a997-a6f6244113f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:37.231026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9075-6489-448a-a997-a6f6244113f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:37.232667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-684c9075-6489-448a-a997-a6f6244113f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:37.346332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c9075-6489-448a-a997-a6f6244113f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:37.347747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c9075-6489-448a-a997-a6f6244113f7 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:37.366436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 726/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:39.756514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284c9ec-0e3c-4beb-b849-43aa5053b858 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:39.757480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284c9ec-0e3c-4beb-b849-43aa5053b858 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:39.757480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284c9ec-0e3c-4beb-b849-43aa5053b858 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:39.759741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:39.766199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a88838-fc3d-4814-b400-90ffe37bcd03 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:39.766923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a88838-fc3d-4814-b400-90ffe37bcd03 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:39.767101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a88838-fc3d-4814-b400-90ffe37bcd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:39.821534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:39.842324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-25a88838-fc3d-4814-b400-90ffe37bcd03 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:39.843707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25a88838-fc3d-4814-b400-90ffe37bcd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:39.941817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:39.984802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284c9ec-0e3c-4beb-b849-43aa5053b858 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:39.986402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4284c9ec-0e3c-4beb-b849-43aa5053b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:40.114101 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284c9ec-0e3c-4beb-b849-43aa5053b858 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:40.164348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:40.210014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec7b24-77e8-466c-9e39-314b994fa298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:40.210647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7b24-77e8-466c-9e39-314b994fa298 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:40.210929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7b24-77e8-466c-9e39-314b994fa298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:40.211204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7b24-77e8-466c-9e39-314b994fa298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:40.212859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-60ec7b24-77e8-466c-9e39-314b994fa298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:40.345325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec7b24-77e8-466c-9e39-314b994fa298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:40.346806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec7b24-77e8-466c-9e39-314b994fa298 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:40.366962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 722/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:42.507638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11fb19-c696-42ed-872a-87d57cd735af None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:42.508179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11fb19-c696-42ed-872a-87d57cd735af None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:42.508179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11fb19-c696-42ed-872a-87d57cd735af None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:42.510112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:42.516408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e65c7-33ed-4e52-8041-f49b0b430af5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:42.516821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e65c7-33ed-4e52-8041-f49b0b430af5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:42.516988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e65c7-33ed-4e52-8041-f49b0b430af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:42.592138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-de9e65c7-33ed-4e52-8041-f49b0b430af5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:42.594144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-de9e65c7-33ed-4e52-8041-f49b0b430af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:42.620603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:42.700247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:42.739310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11fb19-c696-42ed-872a-87d57cd735af None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:42.740837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fd11fb19-c696-42ed-872a-87d57cd735af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:42.852923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11fb19-c696-42ed-872a-87d57cd735af None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:42.873774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:42.930090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c17101-1afe-401a-8b45-af158cda4be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:42.930720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c17101-1afe-401a-8b45-af158cda4be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:42.931000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c17101-1afe-401a-8b45-af158cda4be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:42.931278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c17101-1afe-401a-8b45-af158cda4be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:42.932936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-45c17101-1afe-401a-8b45-af158cda4be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:43.051882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c17101-1afe-401a-8b45-af158cda4be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:43.053379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c17101-1afe-401a-8b45-af158cda4be0 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:43.071424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 729/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:45.112079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366edf-4f29-47e7-ab80-b2f582bf4aba None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:45.112661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366edf-4f29-47e7-ab80-b2f582bf4aba None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:45.112661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366edf-4f29-47e7-ab80-b2f582bf4aba None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:45.114041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:25:45.120491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c3bc9-d279-4f90-bee2-9f44b40a0aec None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:45.121388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c3bc9-d279-4f90-bee2-9f44b40a0aec None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:45.121508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c3bc9-d279-4f90-bee2-9f44b40a0aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:45.198350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:45.201494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-378c3bc9-d279-4f90-bee2-9f44b40a0aec None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:45.203354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-378c3bc9-d279-4f90-bee2-9f44b40a0aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:45.314258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:45.352545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6366edf-4f29-47e7-ab80-b2f582bf4aba None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:45.354208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d6366edf-4f29-47e7-ab80-b2f582bf4aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:45.462643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6366edf-4f29-47e7-ab80-b2f582bf4aba None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:45.520816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:45.546902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dceda-0f17-41c2-afe1-64d4becbcb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:45.547524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dceda-0f17-41c2-afe1-64d4becbcb8b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:45.547801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dceda-0f17-41c2-afe1-64d4becbcb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:45.548070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dceda-0f17-41c2-afe1-64d4becbcb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:45.549722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f10dceda-0f17-41c2-afe1-64d4becbcb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:45.664342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dceda-0f17-41c2-afe1-64d4becbcb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:45.665846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dceda-0f17-41c2-afe1-64d4becbcb8b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:45.684417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 725/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:47.770729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95bc93-bcb3-46f8-ac45-d7c573314c80 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:47.771616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95bc93-bcb3-46f8-ac45-d7c573314c80 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:47.771616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95bc93-bcb3-46f8-ac45-d7c573314c80 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:47.774077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:47.779594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d197d-d38d-4f84-a1fb-bc6cc69d5082 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:47.780048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d197d-d38d-4f84-a1fb-bc6cc69d5082 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:47.780158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d197d-d38d-4f84-a1fb-bc6cc69d5082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:47.849174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d16d197d-d38d-4f84-a1fb-bc6cc69d5082 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:47.850421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d16d197d-d38d-4f84-a1fb-bc6cc69d5082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:47.881429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:47.952109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:47.996197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95bc93-bcb3-46f8-ac45-d7c573314c80 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:47.997769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ac95bc93-bcb3-46f8-ac45-d7c573314c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:48.115923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95bc93-bcb3-46f8-ac45-d7c573314c80 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:48.147131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:48.205835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff8040-07df-4591-8485-376713b4c65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:48.206468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8040-07df-4591-8485-376713b4c65b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:48.207102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8040-07df-4591-8485-376713b4c65b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:48.207384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8040-07df-4591-8485-376713b4c65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:48.209045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-feff8040-07df-4591-8485-376713b4c65b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:48.320171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff8040-07df-4591-8485-376713b4c65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:48.321652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff8040-07df-4591-8485-376713b4c65b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:48.340533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 732/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:50.394683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ff54-d9b3-417d-97ce-6b44ebf94b85 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:50.395289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ff54-d9b3-417d-97ce-6b44ebf94b85 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:50.395289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ff54-d9b3-417d-97ce-6b44ebf94b85 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:50.396606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:50.403113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf79491-955f-48d0-8282-69510fa67f61 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:50.403530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf79491-955f-48d0-8282-69510fa67f61 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:50.403530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf79491-955f-48d0-8282-69510fa67f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:50.473121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-faf79491-955f-48d0-8282-69510fa67f61 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:50.474377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-faf79491-955f-48d0-8282-69510fa67f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:50.482982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:50.577152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:50.618634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ff54-d9b3-417d-97ce-6b44ebf94b85 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:50.621077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9ed9ff54-d9b3-417d-97ce-6b44ebf94b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:50.737373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ff54-d9b3-417d-97ce-6b44ebf94b85 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:50.793940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:50.813833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102cf22-8fc6-40ad-8690-4e303fc0370e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:50.814450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102cf22-8fc6-40ad-8690-4e303fc0370e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:50.814725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102cf22-8fc6-40ad-8690-4e303fc0370e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:50.814994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102cf22-8fc6-40ad-8690-4e303fc0370e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:50.816612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5102cf22-8fc6-40ad-8690-4e303fc0370e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:50.935257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102cf22-8fc6-40ad-8690-4e303fc0370e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:50.936742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102cf22-8fc6-40ad-8690-4e303fc0370e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:50.955768 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 728/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:52.969252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d8af-d276-4773-b1fa-7d16110ad175 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:52.969969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d8af-d276-4773-b1fa-7d16110ad175 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:52.969969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d8af-d276-4773-b1fa-7d16110ad175 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:52.971195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:52.977684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ee02-ba21-4523-99ca-c23e6e72ef2b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:52.978152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ee02-ba21-4523-99ca-c23e6e72ef2b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:52.978259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ee02-ba21-4523-99ca-c23e6e72ef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:53.051357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dfa1ee02-ba21-4523-99ca-c23e6e72ef2b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:53.052559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dfa1ee02-ba21-4523-99ca-c23e6e72ef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:53.098173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:53.157064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:53.196602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d8af-d276-4773-b1fa-7d16110ad175 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:53.198230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b314d8af-d276-4773-b1fa-7d16110ad175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:53.304589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d8af-d276-4773-b1fa-7d16110ad175 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:53.352186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:53.393023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2adf-aaa7-4084-8af7-a9aeebacd70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:53.393701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2adf-aaa7-4084-8af7-a9aeebacd70a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:53.393985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2adf-aaa7-4084-8af7-a9aeebacd70a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:53.394255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2adf-aaa7-4084-8af7-a9aeebacd70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:53.395901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-147f2adf-aaa7-4084-8af7-a9aeebacd70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:53.513385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2adf-aaa7-4084-8af7-a9aeebacd70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:53.514753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2adf-aaa7-4084-8af7-a9aeebacd70a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:53.533881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 735/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:55.548228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695751a-957d-4ddf-9be8-6ad6e8530bc3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:55.548797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695751a-957d-4ddf-9be8-6ad6e8530bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:55.548797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695751a-957d-4ddf-9be8-6ad6e8530bc3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:55.550118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:25:55.556600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee6237-1788-48a9-b4e2-6b1f273bf770 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:55.557036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee6237-1788-48a9-b4e2-6b1f273bf770 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:55.557170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee6237-1788-48a9-b4e2-6b1f273bf770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:55.629393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7fee6237-1788-48a9-b4e2-6b1f273bf770 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:55.630623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7fee6237-1788-48a9-b4e2-6b1f273bf770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:55.649067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:55.730939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:55.770862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695751a-957d-4ddf-9be8-6ad6e8530bc3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:55.772422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f695751a-957d-4ddf-9be8-6ad6e8530bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:55.879337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695751a-957d-4ddf-9be8-6ad6e8530bc3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:55.953888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:55.961340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169211-f3c4-467f-8e0b-c89890142c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:55.961974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169211-f3c4-467f-8e0b-c89890142c14 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:55.962261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169211-f3c4-467f-8e0b-c89890142c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:55.962533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169211-f3c4-467f-8e0b-c89890142c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:55.964454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f4169211-f3c4-467f-8e0b-c89890142c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:56.075959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4169211-f3c4-467f-8e0b-c89890142c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:56.077471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4169211-f3c4-467f-8e0b-c89890142c14 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:56.097048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 731/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:25:58.102705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556fa5-c407-4b6a-b10e-db9931909b54 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:58.103589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556fa5-c407-4b6a-b10e-db9931909b54 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:58.103589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556fa5-c407-4b6a-b10e-db9931909b54 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:58.105878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:25:58.113658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f3b19-6c8c-43da-a1d5-2964bf2e0b6f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:58.114429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f3b19-6c8c-43da-a1d5-2964bf2e0b6f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:58.116507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f3b19-6c8c-43da-a1d5-2964bf2e0b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:58.193389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ce9f3b19-6c8c-43da-a1d5-2964bf2e0b6f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:25:58.194642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ce9f3b19-6c8c-43da-a1d5-2964bf2e0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:58.250874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:58.299063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:25:58.339504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556fa5-c407-4b6a-b10e-db9931909b54 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:25:58.342022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4d556fa5-c407-4b6a-b10e-db9931909b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:58.463449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556fa5-c407-4b6a-b10e-db9931909b54 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:25:58.526728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:58.559083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fd5cc-d27f-4734-a793-cb92febc0244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:25:58.559720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fd5cc-d27f-4734-a793-cb92febc0244 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:25:58.559999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fd5cc-d27f-4734-a793-cb92febc0244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:25:58.560270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fd5cc-d27f-4734-a793-cb92febc0244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:25:58.561951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-779fd5cc-d27f-4734-a793-cb92febc0244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:25:58.680845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fd5cc-d27f-4734-a793-cb92febc0244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:25:58.682320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fd5cc-d27f-4734-a793-cb92febc0244 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:25:58.701257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 738/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:26:08.297159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=22 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:08.698929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=66 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:18.111140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18bc14-a580-4ff5-bd45-004f5be282b3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:18.111720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18bc14-a580-4ff5-bd45-004f5be282b3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:18.111720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18bc14-a580-4ff5-bd45-004f5be282b3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:18.113054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 733/1471] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:18.119562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a42c4-dd57-4b8e-ab5c-6a215e70312b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:18.120166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a42c4-dd57-4b8e-ab5c-6a215e70312b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:18.120339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a42c4-dd57-4b8e-ab5c-6a215e70312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:18.193791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ed2a42c4-dd57-4b8e-ab5c-6a215e70312b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:18.195044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ed2a42c4-dd57-4b8e-ab5c-6a215e70312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:18.298643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 739/1472] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:18.385255 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d5b6-5073-414c-84ed-2648f01e9a64 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:18.385563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d5b6-5073-414c-84ed-2648f01e9a64 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:18.385837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d5b6-5073-414c-84ed-2648f01e9a64 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:18.387299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 734/1473] 10.222.0.47 () {54 vars in 966 bytes} [Fri Jul 29 08:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:18.392431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf6710-b059-4bb9-94bb-a91ec724f814 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:18.392722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf6710-b059-4bb9-94bb-a91ec724f814 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:18.393001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf6710-b059-4bb9-94bb-a91ec724f814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:18.475812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c3bf6710-b059-4bb9-94bb-a91ec724f814 None None] MFA Rules not processed for user `fb625a81268d4067a59dbd34de4019cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:18.477040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3bf6710-b059-4bb9-94bb-a91ec724f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:18.498651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:18.554267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 740/1474] 10.222.0.47 () {58 vars in 1063 bytes} [Fri Jul 29 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:18.565813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9d5b6-5073-414c-84ed-2648f01e9a64 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:26:18.567374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b1e9d5b6-5073-414c-84ed-2648f01e9a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:18.679357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9d5b6-5073-414c-84ed-2648f01e9a64 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:26:18.758527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd0a43-5e52-4bdf-b296-4e10eda63626 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:26:18.759142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0a43-5e52-4bdf-b296-4e10eda63626 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:18.759424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0a43-5e52-4bdf-b296-4e10eda63626 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:18.759694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0a43-5e52-4bdf-b296-4e10eda63626 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:18.761337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c1dd0a43-5e52-4bdf-b296-4e10eda63626 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:18.817072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:18.876124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd0a43-5e52-4bdf-b296-4e10eda63626 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:26:18.877607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd0a43-5e52-4bdf-b296-4e10eda63626 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:26:18.897275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 735/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:26:20.986763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9934c-7f19-4547-9d68-49ea3f0effa0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:20.987732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9934c-7f19-4547-9d68-49ea3f0effa0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:20.987732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9934c-7f19-4547-9d68-49ea3f0effa0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:20.989955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 741/1476] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:20.998398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a523-fca4-40bd-a5a6-d7ddea138171 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:20.998800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a523-fca4-40bd-a5a6-d7ddea138171 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:20.998952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a523-fca4-40bd-a5a6-d7ddea138171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:21.065005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4963a523-fca4-40bd-a5a6-d7ddea138171 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:21.066322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4963a523-fca4-40bd-a5a6-d7ddea138171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:21.164485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 736/1477] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:21.187392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9934c-7f19-4547-9d68-49ea3f0effa0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:26:21.188928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-94d9934c-7f19-4547-9d68-49ea3f0effa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:21.330039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9934c-7f19-4547-9d68-49ea3f0effa0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:26:21.390278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:21.437059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa4c8e-098d-4ed6-866f-8463cd852ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:26:21.437718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa4c8e-098d-4ed6-866f-8463cd852ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:21.437991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa4c8e-098d-4ed6-866f-8463cd852ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:21.438398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa4c8e-098d-4ed6-866f-8463cd852ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:21.439653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa4c8e-098d-4ed6-866f-8463cd852ab8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:26:21.442182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-adaa4c8e-098d-4ed6-866f-8463cd852ab8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:26:21.442182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:26:21.442182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:26:21.444028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa4c8e-098d-4ed6-866f-8463cd852ab8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:26:21.466129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 742/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Jul 29 08:26:21 2022] GET /identity/v3/projects => generated 2553 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:26:23.465490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8838e2-dee6-405c-8628-813c3cc2bc71 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:23.466152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8838e2-dee6-405c-8628-813c3cc2bc71 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:23.466152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8838e2-dee6-405c-8628-813c3cc2bc71 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:23.467483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 737/1479] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:23.473896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dd8f-fb5b-4f32-9b75-3e4a49ad9dd0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:23.474659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dd8f-fb5b-4f32-9b75-3e4a49ad9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:23.474837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dd8f-fb5b-4f32-9b75-3e4a49ad9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:23.553149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ca62dd8f-fb5b-4f32-9b75-3e4a49ad9dd0 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:23.554283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca62dd8f-fb5b-4f32-9b75-3e4a49ad9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:23.659344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 743/1480] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:23.703989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8838e2-dee6-405c-8628-813c3cc2bc71 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:26:23.705795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8c8838e2-dee6-405c-8628-813c3cc2bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:23.719394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:23.855779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8838e2-dee6-405c-8628-813c3cc2bc71 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:26:23.959488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:23.998987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea8dba-41e1-43db-9a03-cf5685855cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:26:23.999647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea8dba-41e1-43db-9a03-cf5685855cd6 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:23.999927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea8dba-41e1-43db-9a03-cf5685855cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:24.000273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea8dba-41e1-43db-9a03-cf5685855cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:24.001960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3dea8dba-41e1-43db-9a03-cf5685855cd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:24.099908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea8dba-41e1-43db-9a03-cf5685855cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:26:24.101544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea8dba-41e1-43db-9a03-cf5685855cd6 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:26:24.120610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 738/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:26:26.299899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf73205-4518-4a0e-b9d5-ed65b35089d5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:26.300445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf73205-4518-4a0e-b9d5-ed65b35089d5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:26.300445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf73205-4518-4a0e-b9d5-ed65b35089d5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:26.302478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 744/1482] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:26:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:26.309940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290077-dfbc-40b4-8747-a55eb7e9ac8f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:26.310654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290077-dfbc-40b4-8747-a55eb7e9ac8f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:26.310757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290077-dfbc-40b4-8747-a55eb7e9ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:26.390785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ca290077-dfbc-40b4-8747-a55eb7e9ac8f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:26.392025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ca290077-dfbc-40b4-8747-a55eb7e9ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:26.442008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:26.499584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 739/1483] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:26.538855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf73205-4518-4a0e-b9d5-ed65b35089d5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:26:26.540843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-faf73205-4518-4a0e-b9d5-ed65b35089d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:26.568002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:26.652714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf73205-4518-4a0e-b9d5-ed65b35089d5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:26:26.733536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d0529-26b7-4beb-a860-810ef7ffb91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:26:26.734110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d0529-26b7-4beb-a860-810ef7ffb91d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:26.734346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d0529-26b7-4beb-a860-810ef7ffb91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:26.734624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d0529-26b7-4beb-a860-810ef7ffb91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:26.736303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-856d0529-26b7-4beb-a860-810ef7ffb91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:26.812428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:26.850572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d0529-26b7-4beb-a860-810ef7ffb91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:26:26.852061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d0529-26b7-4beb-a860-810ef7ffb91d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:26:26.871104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 745/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:26:28.925074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a13c4-0f19-4ec7-93e4-e88cc09392b0 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:28.925546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a13c4-0f19-4ec7-93e4-e88cc09392b0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:28.925660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a13c4-0f19-4ec7-93e4-e88cc09392b0 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:28.927015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 740/1485] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:28.935869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358034-76e5-49d4-8c1e-6c651e063f66 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:28.936637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358034-76e5-49d4-8c1e-6c651e063f66 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:28.936777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358034-76e5-49d4-8c1e-6c651e063f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:29.015906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-53358034-76e5-49d4-8c1e-6c651e063f66 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:29.017129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-53358034-76e5-49d4-8c1e-6c651e063f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:29.122183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 746/1486] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:29.163973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a13c4-0f19-4ec7-93e4-e88cc09392b0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:26:29.166417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f80a13c4-0f19-4ec7-93e4-e88cc09392b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:29.288504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a13c4-0f19-4ec7-93e4-e88cc09392b0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:26:29.379701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:29.381924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cb6c2-236a-4ba4-9004-d5cadc0e452f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:26:29.382764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb6c2-236a-4ba4-9004-d5cadc0e452f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:29.383092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb6c2-236a-4ba4-9004-d5cadc0e452f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:29.383482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb6c2-236a-4ba4-9004-d5cadc0e452f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:29.386659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2e1cb6c2-236a-4ba4-9004-d5cadc0e452f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:29.506005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb6c2-236a-4ba4-9004-d5cadc0e452f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:26:29.507373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb6c2-236a-4ba4-9004-d5cadc0e452f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:26:29.525963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 741/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:26:31.671634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344807e6-4a26-46ee-a892-a86778b25143 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:31.672231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344807e6-4a26-46ee-a892-a86778b25143 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:31.672231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344807e6-4a26-46ee-a892-a86778b25143 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:31.674364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 747/1488] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:31.679949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0850ab7-c39d-4e47-a711-f8e3e82eb901 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:31.680408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0850ab7-c39d-4e47-a711-f8e3e82eb901 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:31.680518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0850ab7-c39d-4e47-a711-f8e3e82eb901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:31.754814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e0850ab7-c39d-4e47-a711-f8e3e82eb901 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:31.756055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e0850ab7-c39d-4e47-a711-f8e3e82eb901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:31.812525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:31.869527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 742/1489] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:31.909840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344807e6-4a26-46ee-a892-a86778b25143 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:26:31.911434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-344807e6-4a26-46ee-a892-a86778b25143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:31.949906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:32.021674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344807e6-4a26-46ee-a892-a86778b25143 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:26:32.117084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7d634-9ea2-4649-be9e-4fd712e05971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:26:32.117743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d634-9ea2-4649-be9e-4fd712e05971 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:32.118033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d634-9ea2-4649-be9e-4fd712e05971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:32.118308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d634-9ea2-4649-be9e-4fd712e05971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:32.119958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-81b7d634-9ea2-4649-be9e-4fd712e05971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:32.213468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:32.243806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7d634-9ea2-4649-be9e-4fd712e05971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:26:32.245252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7d634-9ea2-4649-be9e-4fd712e05971 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:26:32.264353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 748/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:26:34.455491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb24243-d647-4d80-8d50-0ee6a7e0886b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:34.456400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb24243-d647-4d80-8d50-0ee6a7e0886b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:34.456400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb24243-d647-4d80-8d50-0ee6a7e0886b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:34.458867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 743/1491] 10.222.0.47 () {54 vars in 926 bytes} [Fri Jul 29 08:26:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:26:34.464510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c5166-c2ec-4d03-8476-180906e56776 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:34.464976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c5166-c2ec-4d03-8476-180906e56776 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:34.465080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c5166-c2ec-4d03-8476-180906e56776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:34.532138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-344c5166-c2ec-4d03-8476-180906e56776 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:26:34.533411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-344c5166-c2ec-4d03-8476-180906e56776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:34.635182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 749/1492] 10.222.0.47 () {58 vars in 1023 bytes} [Fri Jul 29 08:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:26:34.676595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb24243-d647-4d80-8d50-0ee6a7e0886b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:26:34.678776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-edb24243-d647-4d80-8d50-0ee6a7e0886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:34.792455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb24243-d647-4d80-8d50-0ee6a7e0886b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:26:34.869305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7da0b7-f1ef-49c7-9763-a09828e9ace3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:26:34.869934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7da0b7-f1ef-49c7-9763-a09828e9ace3 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:26:34.870219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7da0b7-f1ef-49c7-9763-a09828e9ace3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:26:34.870494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7da0b7-f1ef-49c7-9763-a09828e9ace3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:26:34.872132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8a7da0b7-f1ef-49c7-9763-a09828e9ace3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:26:34.881549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:34.986176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7da0b7-f1ef-49c7-9763-a09828e9ace3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:26:34.987627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7da0b7-f1ef-49c7-9763-a09828e9ace3 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:26:35.006986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 744/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:26:44.633664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=82 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:45.004636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=50 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:20.973112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:20.973799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:20.973799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:21.052906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:28:21.054181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:21.157393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 750/1494] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:28:21.165976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39483ad1-3d83-4a2a-a7b0-402436572e69 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:21.166460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39483ad1-3d83-4a2a-a7b0-402436572e69 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:21.166555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39483ad1-3d83-4a2a-a7b0-402436572e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:21.249387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-39483ad1-3d83-4a2a-a7b0-402436572e69 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:28:21.250533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-39483ad1-3d83-4a2a-a7b0-402436572e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:21.369073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 745/1495] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:28:21.374640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:21.376450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:21.392542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b34c02-18fe-4e3a-9b3e-0157c45696c1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:21.459766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:21.496297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:21.496976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:21.497240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:21.497528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:21.498281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:28:21.498595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:21.499667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:21.499667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:28:21.499667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:28:21.500484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:21.516165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 751/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:28:21.525947 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39483ad1-3d83-4a2a-a7b0-402436572e69 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:21.541951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39483ad1-3d83-4a2a-a7b0-402436572e69 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:21.610405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:21.645733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:21.646361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:21.646636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:21.646911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:21.647566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:21.649380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:21.649380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Jul 29 08:28:21.649380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: Jul 29 08:28:21.650569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:21.709647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 746/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:28:21 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:28:21.714186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:21.715751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:21.753209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945a9ce-f3fa-493e-9e5f-6a9bd5603522 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:21.852794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:21.853452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:21.853714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:21.854005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:21.854675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:21.855691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:21.855691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:28:21.855691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:28:21.857126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:21.910535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 752/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:28:21 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:28:21.914867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:21.916467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:21.989989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78165426-815c-4923-9cdb-65bdeeafa1fd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:22.081970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:22.094360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:22.094986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:22.095263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:22.095530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:22.096221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:22.097306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:22.097306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Jul 29 08:28:22.097306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: Jul 29 08:28:22.098180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:22.110668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 747/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:28:22.114950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:22.116478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:22.128332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99dd4-23d9-47a0-9686-3d17181538b6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:22.155446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:22.243240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4110d70-91f7-4bd9-893a-18ee31e30eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:22.243885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110d70-91f7-4bd9-893a-18ee31e30eff admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:22.244162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110d70-91f7-4bd9-893a-18ee31e30eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:22.244433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110d70-91f7-4bd9-893a-18ee31e30eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:22.245135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4110d70-91f7-4bd9-893a-18ee31e30eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:22.246190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-b4110d70-91f7-4bd9-893a-18ee31e30eff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:22.246190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:28:22.246190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:28:22.247076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4110d70-91f7-4bd9-893a-18ee31e30eff admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:22.261305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 753/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:28:22.265954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:22.267512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:22.303121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e921-d41c-4026-bbc6-a786bdb74cf8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:22.412072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa382a28-5f9b-45d1-b25b-192dd00d099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:22.413049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382a28-5f9b-45d1-b25b-192dd00d099e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:22.413332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382a28-5f9b-45d1-b25b-192dd00d099e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:22.413735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382a28-5f9b-45d1-b25b-192dd00d099e admin admin] PATH_INFO: `/v3/projects/925d10a1af0b4376b778c0864047d9fe/users/b2d07ff7930a4766b70999f77f8d4e82/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:22.445015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa382a28-5f9b-45d1-b25b-192dd00d099e admin admin] RBAC: Authorizing `identity:create_grant(project_id=925d10a1af0b4376b778c0864047d9fe, user_id=b2d07ff7930a4766b70999f77f8d4e82, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:22.446193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-fa382a28-5f9b-45d1-b25b-192dd00d099e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:22.446193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Jul 29 08:28:22.446193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: Jul 29 08:28:22.448129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa382a28-5f9b-45d1-b25b-192dd00d099e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:22.475224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 748/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:28:22 2022] PUT /identity/v3/projects/925d10a1af0b4376b778c0864047d9fe/users/b2d07ff7930a4766b70999f77f8d4e82/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:28:22.487789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58ed1-78b8-42e5-99f2-5d6d96020270 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:22.488076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58ed1-78b8-42e5-99f2-5d6d96020270 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:22.488382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58ed1-78b8-42e5-99f2-5d6d96020270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:22.547137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-93d58ed1-78b8-42e5-99f2-5d6d96020270 None None] MFA Rules not processed for user `b2d07ff7930a4766b70999f77f8d4e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:28:22.548358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-93d58ed1-78b8-42e5-99f2-5d6d96020270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:22.641939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 754/1502] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:28:22.659688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a20da-9222-4c38-842b-b33fb8d23bf7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:22.659980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a20da-9222-4c38-842b-b33fb8d23bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:22.660251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a20da-9222-4c38-842b-b33fb8d23bf7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:22.661685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 749/1503] 10.222.0.47 () {54 vars in 964 bytes} [Fri Jul 29 08:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:28:22.666643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97430e-36c4-4473-ace8-68219f0dbbdd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:22.666877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97430e-36c4-4473-ace8-68219f0dbbdd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:22.667160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97430e-36c4-4473-ace8-68219f0dbbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:22.698637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:22.757937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6c97430e-36c4-4473-ace8-68219f0dbbdd None None] MFA Rules not processed for user `8436207924e742caafdc816b373fd40b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:28:22.759158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6c97430e-36c4-4473-ace8-68219f0dbbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:22.847191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 755/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Fri Jul 29 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:28:22.859226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a20da-9222-4c38-842b-b33fb8d23bf7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:22.860755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d39a20da-9222-4c38-842b-b33fb8d23bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:22.912330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:22.968079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a20da-9222-4c38-842b-b33fb8d23bf7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:23.047030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:23.047668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:23.047946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:23.048218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:23.049909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:23.165674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:23.167133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:23.170617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:23.186958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 750/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:28:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:28:23.237124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040a74-0689-4cfb-9156-292264c8392b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:23.237677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040a74-0689-4cfb-9156-292264c8392b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:23.237677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040a74-0689-4cfb-9156-292264c8392b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:23.239000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 756/1506] 10.222.0.47 () {52 vars in 830 bytes} [Fri Jul 29 08:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:28:23.244313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:23.245580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:23.358241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502355ad-4a8e-4436-8533-8486e118f263 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:23.460734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:23.461415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:23.461687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:23.461960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] PATH_INFO: `/v3/users/b2d07ff7930a4766b70999f77f8d4e82` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:23.474410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d07ff7930a4766b70999f77f8d4e82)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:23.475386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:23.475386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Jul 29 08:28:23.475386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: Jul 29 08:28:23.476581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:23.486480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:23.545462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d07ff7930a4766b70999f77f8d4e82'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:23.559955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d07ff7930a4766b70999f77f8d4e82'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:23.571845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d07ff7930a4766b70999f77f8d4e82'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:23.590980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d07ff7930a4766b70999f77f8d4e82'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:23.591443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d07ff7930a4766b70999f77f8d4e82'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:23.597023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 751/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:28:23 2022] DELETE /identity/v3/users/b2d07ff7930a4766b70999f77f8d4e82 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:28:23.601633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:23.601926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:23.602198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:23.663805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:28:23.665063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:23.742133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:23.755555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 757/1508] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:28:23.766061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:23.767334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:23.872456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929caf18-fef1-4adc-9c7b-f29652aaf566 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:23.930706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:23.960335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da338b9-8c1b-42b7-850e-60ffb1425ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:23.961247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da338b9-8c1b-42b7-850e-60ffb1425ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:23.961637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da338b9-8c1b-42b7-850e-60ffb1425ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:23.962022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da338b9-8c1b-42b7-850e-60ffb1425ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:23.964492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7da338b9-8c1b-42b7-850e-60ffb1425ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:24.091943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da338b9-8c1b-42b7-850e-60ffb1425ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:24.093519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da338b9-8c1b-42b7-850e-60ffb1425ffd service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:24.116363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 752/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:28:24.474791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:28:24.476536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:28:24.490678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f43dd-045a-486b-acf0-5b81645ba9a4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:28:24.596505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:28:24.597222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:28:24.597484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:28:24.597747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] PATH_INFO: `/v3/projects/925d10a1af0b4376b778c0864047d9fe` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:28:24.608951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925d10a1af0b4376b778c0864047d9fe)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:28:24.610008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:28:24.610008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:28:24.610008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:28:24.611206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:28:24.673427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925d10a1af0b4376b778c0864047d9fe', 'request_id': 'req-b4c6d7de-a860-41c1-9e70-94420781e178'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:24.680581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925d10a1af0b4376b778c0864047d9fe', 'request_id': 'req-b4c6d7de-a860-41c1-9e70-94420781e178'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:24.691196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925d10a1af0b4376b778c0864047d9fe', 'request_id': 'req-b4c6d7de-a860-41c1-9e70-94420781e178'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:24.723680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] The token cache is being invalidate because project 925d10a1af0b4376b778c0864047d9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:28:24.723966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:24.724396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b4c6d7de-a860-41c1-9e70-94420781e178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:28:24.725866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 758/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:28:24 2022] DELETE /identity/v3/projects/925d10a1af0b4376b778c0864047d9fe => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:28:34.112084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=62 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:28:34.721398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:07.708650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25734767-cda9-4c88-a54f-dbc7757d19e5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:07.709676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25734767-cda9-4c88-a54f-dbc7757d19e5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:07.709676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25734767-cda9-4c88-a54f-dbc7757d19e5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:07.711884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:30:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:07.716979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cede95-afb0-4411-902b-30c130fabdd2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:07.717456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cede95-afb0-4411-902b-30c130fabdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:07.717564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cede95-afb0-4411-902b-30c130fabdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:07.804444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b9cede95-afb0-4411-902b-30c130fabdd2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:07.805712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b9cede95-afb0-4411-902b-30c130fabdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:07.913991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:08.070788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25734767-cda9-4c88-a54f-dbc7757d19e5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:08.074406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-25734767-cda9-4c88-a54f-dbc7757d19e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:08.204435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25734767-cda9-4c88-a54f-dbc7757d19e5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:08.210647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76a9f-7052-4fb8-8567-bb673fb01845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:08.211261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76a9f-7052-4fb8-8567-bb673fb01845 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:08.211566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76a9f-7052-4fb8-8567-bb673fb01845 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:08.211848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76a9f-7052-4fb8-8567-bb673fb01845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:08.220103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76a9f-7052-4fb8-8567-bb673fb01845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:08.221756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76a9f-7052-4fb8-8567-bb673fb01845 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:08.231660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 754/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:09.066746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c864003-443d-43c4-9394-79d5cc9d4c90 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:09.067370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c864003-443d-43c4-9394-79d5cc9d4c90 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:09.067370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c864003-443d-43c4-9394-79d5cc9d4c90 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:09.068688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:09.074784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a737d-c0d0-4d92-b140-e2ff2bf72407 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:09.075229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a737d-c0d0-4d92-b140-e2ff2bf72407 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:09.075342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a737d-c0d0-4d92-b140-e2ff2bf72407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:09.099156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-908a737d-c0d0-4d92-b140-e2ff2bf72407 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:09.100359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-908a737d-c0d0-4d92-b140-e2ff2bf72407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:09.109877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:09.264293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c864003-443d-43c4-9394-79d5cc9d4c90 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:09.281299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c864003-443d-43c4-9394-79d5cc9d4c90 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:09.288630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbed8b-6efc-4bdc-9a81-fea73a37aa0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:09.289244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbed8b-6efc-4bdc-9a81-fea73a37aa0b service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:09.289558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbed8b-6efc-4bdc-9a81-fea73a37aa0b service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:09.289834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbed8b-6efc-4bdc-9a81-fea73a37aa0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:09.300021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbed8b-6efc-4bdc-9a81-fea73a37aa0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:09.302802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbed8b-6efc-4bdc-9a81-fea73a37aa0b service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:09.318125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 761/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:30:09.373639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9dd47-b4b6-46fa-bfb5-c7f0376d48ac None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:09.373924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9dd47-b4b6-46fa-bfb5-c7f0376d48ac None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:09.374222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9dd47-b4b6-46fa-bfb5-c7f0376d48ac None None] PATH_INFO: `/v3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:09.375660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 756/1517] 10.222.0.49 () {54 vars in 925 bytes} [Fri Jul 29 08:30:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:30:09.383398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b401d-de22-4cd2-b1cc-9fc32cbea36c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:09.383648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b401d-de22-4cd2-b1cc-9fc32cbea36c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:09.383953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b401d-de22-4cd2-b1cc-9fc32cbea36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:09.450323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7c3b401d-de22-4cd2-b1cc-9fc32cbea36c None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:09.451547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7c3b401d-de22-4cd2-b1cc-9fc32cbea36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:09.469006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:09.522968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 762/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Jul 29 08:30:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:18.668282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3852375-c1e6-4714-9c93-bc8cfb295cdb None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:18.668842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3852375-c1e6-4714-9c93-bc8cfb295cdb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:18.668842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3852375-c1e6-4714-9c93-bc8cfb295cdb None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:18.670237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 757/1519] 10.222.0.47 () {54 vars in 961 bytes} [Fri Jul 29 08:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:18.675235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7e5c0-d88f-435d-91d6-bb1ab28507a8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:18.675634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7e5c0-d88f-435d-91d6-bb1ab28507a8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:18.675821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7e5c0-d88f-435d-91d6-bb1ab28507a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:18.695168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-81c7e5c0-d88f-435d-91d6-bb1ab28507a8 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:18.696376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-81c7e5c0-d88f-435d-91d6-bb1ab28507a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:18.705051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 763/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Jul 29 08:30:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:30:18.713463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3852375-c1e6-4714-9c93-bc8cfb295cdb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:18.727395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3852375-c1e6-4714-9c93-bc8cfb295cdb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:18.732400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c76d5-db0a-4fce-a6d1-b55a9092635d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:18.733095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c76d5-db0a-4fce-a6d1-b55a9092635d service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:18.733411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c76d5-db0a-4fce-a6d1-b55a9092635d service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:18.733682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c76d5-db0a-4fce-a6d1-b55a9092635d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:18.742126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c76d5-db0a-4fce-a6d1-b55a9092635d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:18.743715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c76d5-db0a-4fce-a6d1-b55a9092635d service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:18.753504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 758/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:20.546790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a3f1-0946-4a78-b9b1-d8cd5635f056 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:20.547390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a3f1-0946-4a78-b9b1-d8cd5635f056 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:20.547390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a3f1-0946-4a78-b9b1-d8cd5635f056 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:20.548596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:20.554421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece18d0-c49c-4551-b93a-a2f1097a69c6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:20.554844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece18d0-c49c-4551-b93a-a2f1097a69c6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:20.554958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece18d0-c49c-4551-b93a-a2f1097a69c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:20.577934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cece18d0-c49c-4551-b93a-a2f1097a69c6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:20.579134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cece18d0-c49c-4551-b93a-a2f1097a69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:20.589549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:20.741108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08a3f1-0946-4a78-b9b1-d8cd5635f056 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:20.758361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08a3f1-0946-4a78-b9b1-d8cd5635f056 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:20.764326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c86dc8-54fc-489e-beeb-31fd01b3eb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:20.764945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86dc8-54fc-489e-beeb-31fd01b3eb90 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:20.765227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86dc8-54fc-489e-beeb-31fd01b3eb90 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:20.765526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86dc8-54fc-489e-beeb-31fd01b3eb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:20.774107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c86dc8-54fc-489e-beeb-31fd01b3eb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:20.775811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c86dc8-54fc-489e-beeb-31fd01b3eb90 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:20.786009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 765/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:21.606890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed6d-5ea9-4742-a0a0-111f172bb6ff None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:21.607501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed6d-5ea9-4742-a0a0-111f172bb6ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:21.607501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed6d-5ea9-4742-a0a0-111f172bb6ff None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:21.608862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 08:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:21.614338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e1f3-abe0-4418-a38b-069444655074 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:21.614813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e1f3-abe0-4418-a38b-069444655074 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:21.614931 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e1f3-abe0-4418-a38b-069444655074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:21.636270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2a99e1f3-abe0-4418-a38b-069444655074 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:21.637543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2a99e1f3-abe0-4418-a38b-069444655074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:21.647219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 08:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:21.801244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eed6d-5ea9-4742-a0a0-111f172bb6ff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:21.820084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eed6d-5ea9-4742-a0a0-111f172bb6ff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:21.826258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc04a61-cbde-402e-a918-bb5eb12eaff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:21.826882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04a61-cbde-402e-a918-bb5eb12eaff2 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:21.827162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04a61-cbde-402e-a918-bb5eb12eaff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:21.827441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04a61-cbde-402e-a918-bb5eb12eaff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:21.836695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc04a61-cbde-402e-a918-bb5eb12eaff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:21.838352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc04a61-cbde-402e-a918-bb5eb12eaff2 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:21.848872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 761/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:25.662498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653cd0-efd6-49bf-839e-6613033f23a5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:25.663129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653cd0-efd6-49bf-839e-6613033f23a5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:25.663129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653cd0-efd6-49bf-839e-6613033f23a5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:25.664912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:25.671269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37c66-f8db-4ed9-b959-213d521caf1a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:25.671742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37c66-f8db-4ed9-b959-213d521caf1a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:25.671849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37c66-f8db-4ed9-b959-213d521caf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:25.694747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5bb37c66-f8db-4ed9-b959-213d521caf1a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:25.696579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5bb37c66-f8db-4ed9-b959-213d521caf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:25.706098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:25.784524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b653cd0-efd6-49bf-839e-6613033f23a5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:25.786623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b653cd0-efd6-49bf-839e-6613033f23a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:25.872626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b653cd0-efd6-49bf-839e-6613033f23a5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:25.876685 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb185d16-388f-4b19-9689-a67255531224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:25.877319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185d16-388f-4b19-9689-a67255531224 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:25.877607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185d16-388f-4b19-9689-a67255531224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:25.877881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185d16-388f-4b19-9689-a67255531224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:25.887078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb185d16-388f-4b19-9689-a67255531224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:25.888516 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb185d16-388f-4b19-9689-a67255531224 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:25.898536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 768/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:27.878166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f321d-2341-45e3-8a5a-3e4bebaeaaab None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:27.879038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f321d-2341-45e3-8a5a-3e4bebaeaaab None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:27.879038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f321d-2341-45e3-8a5a-3e4bebaeaaab None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:27.881085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:30:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:27.886736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61c600-5a2f-4470-87fd-0083da3e21e9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:27.887156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61c600-5a2f-4470-87fd-0083da3e21e9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:27.887290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61c600-5a2f-4470-87fd-0083da3e21e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:27.907979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cc61c600-5a2f-4470-87fd-0083da3e21e9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:27.909194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cc61c600-5a2f-4470-87fd-0083da3e21e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:27.918363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:27.953565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f321d-2341-45e3-8a5a-3e4bebaeaaab None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:27.966255 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f321d-2341-45e3-8a5a-3e4bebaeaaab None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:27.970221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8646387-d084-431e-85fe-7deac28e534e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:27.970843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8646387-d084-431e-85fe-7deac28e534e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:27.971118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8646387-d084-431e-85fe-7deac28e534e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:27.971389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8646387-d084-431e-85fe-7deac28e534e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:27.981498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8646387-d084-431e-85fe-7deac28e534e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:27.982955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8646387-d084-431e-85fe-7deac28e534e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:27.992765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 764/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:31.565629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee56fa-fd7b-4310-9418-47db62e26a25 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:31.566476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee56fa-fd7b-4310-9418-47db62e26a25 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:31.566476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee56fa-fd7b-4310-9418-47db62e26a25 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:31.568548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:30:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:31.575910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad75c24-e2ea-4d54-b350-60b233f711f9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:31.576342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad75c24-e2ea-4d54-b350-60b233f711f9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:31.576538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad75c24-e2ea-4d54-b350-60b233f711f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:31.597634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7ad75c24-e2ea-4d54-b350-60b233f711f9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:31.598853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7ad75c24-e2ea-4d54-b350-60b233f711f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:31.608359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:31.914365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee56fa-fd7b-4310-9418-47db62e26a25 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:31.916444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c4ee56fa-fd7b-4310-9418-47db62e26a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:31.986641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:32.001701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee56fa-fd7b-4310-9418-47db62e26a25 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:32.005771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eff7d-8b87-41e4-b9cd-ebc5c04be9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:32.006390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eff7d-8b87-41e4-b9cd-ebc5c04be9aa service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:32.006675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eff7d-8b87-41e4-b9cd-ebc5c04be9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:32.006951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eff7d-8b87-41e4-b9cd-ebc5c04be9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:32.016170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eff7d-8b87-41e4-b9cd-ebc5c04be9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:32.017626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eff7d-8b87-41e4-b9cd-ebc5c04be9aa service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:32.027398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 771/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:34.041749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a911-1ba1-4740-8c29-c8d203c1144b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:34.042264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a911-1ba1-4740-8c29-c8d203c1144b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:34.042264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a911-1ba1-4740-8c29-c8d203c1144b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:34.043642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 08:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:30:34.049097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea183f3-4b81-4939-a755-7e6101502725 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:34.049605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea183f3-4b81-4939-a755-7e6101502725 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:34.049711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea183f3-4b81-4939-a755-7e6101502725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:34.069980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-aea183f3-4b81-4939-a755-7e6101502725 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:30:34.071210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-aea183f3-4b81-4939-a755-7e6101502725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:34.079982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 08:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:30:34.389603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676a911-1ba1-4740-8c29-c8d203c1144b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:30:34.391790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a676a911-1ba1-4740-8c29-c8d203c1144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:30:34.399722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:34.407434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676a911-1ba1-4740-8c29-c8d203c1144b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:30:34.411040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab78056-29ec-4442-b644-b70caf09d0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:30:34.411663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab78056-29ec-4442-b644-b70caf09d0bc service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:30:34.411950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab78056-29ec-4442-b644-b70caf09d0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:30:34.412260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab78056-29ec-4442-b644-b70caf09d0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:30:34.422116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab78056-29ec-4442-b644-b70caf09d0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:30:34.423572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab78056-29ec-4442-b644-b70caf09d0bc service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:30:34.433652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 767/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:30:44.065159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=11 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:44.429272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:05.305541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf63536-09e3-4dac-b152-7959d4035516 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.306656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf63536-09e3-4dac-b152-7959d4035516 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.307165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf63536-09e3-4dac-b152-7959d4035516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.330966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-edf63536-09e3-4dac-b152-7959d4035516 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.333052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-edf63536-09e3-4dac-b152-7959d4035516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.350433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 773/1540] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.359856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ca8f-fd5a-4872-aba7-eada486049d1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.361043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ca8f-fd5a-4872-aba7-eada486049d1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.361604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ca8f-fd5a-4872-aba7-eada486049d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.392889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d685ca8f-fd5a-4872-aba7-eada486049d1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.394598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d685ca8f-fd5a-4872-aba7-eada486049d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.412176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 768/1541] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.416729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf63536-09e3-4dac-b152-7959d4035516 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:05.431458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf63536-09e3-4dac-b152-7959d4035516 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:05.440928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b141c1e-5525-490b-9bac-74c6369547fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:05.442028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b141c1e-5525-490b-9bac-74c6369547fb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.442539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b141c1e-5525-490b-9bac-74c6369547fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.443060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b141c1e-5525-490b-9bac-74c6369547fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.443994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b141c1e-5525-490b-9bac-74c6369547fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:05.444516 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b141c1e-5525-490b-9bac-74c6369547fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:05.446615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b141c1e-5525-490b-9bac-74c6369547fb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:05.466819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 774/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:05.475489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685ca8f-fd5a-4872-aba7-eada486049d1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:05.486561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685ca8f-fd5a-4872-aba7-eada486049d1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:05.495809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:05.496632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.496927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.497208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.497934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:05.500291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:05.558188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e737-adf0-46d3-b5eb-599a520c59fb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.558968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e737-adf0-46d3-b5eb-599a520c59fb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.559488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e737-adf0-46d3-b5eb-599a520c59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.562345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 769/1543] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:05.567232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:05.591056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cc76e737-adf0-46d3-b5eb-599a520c59fb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.592694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cc76e737-adf0-46d3-b5eb-599a520c59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.654252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0bcc7-d2aa-4e51-9d83-5581fdc80c72 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:05.669792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a733e93-eb06-4f44-a76a-0bb1f10d41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:05.670450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a733e93-eb06-4f44-a76a-0bb1f10d41ed admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.670734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a733e93-eb06-4f44-a76a-0bb1f10d41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.671010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a733e93-eb06-4f44-a76a-0bb1f10d41ed admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.672953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a733e93-eb06-4f44-a76a-0bb1f10d41ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:05.674049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-0a733e93-eb06-4f44-a76a-0bb1f10d41ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:32:05.674049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Jul 29 08:32:05.674049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: Jul 29 08:32:05.680260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a733e93-eb06-4f44-a76a-0bb1f10d41ed admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:05.740783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 770/1544] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:32:05.742622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7a6b-a369-4151-bf76-a6b5ed2478dd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.742915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7a6b-a369-4151-bf76-a6b5ed2478dd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.743972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7a6b-a369-4151-bf76-a6b5ed2478dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.746159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 775/1545] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.747072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e737-adf0-46d3-b5eb-599a520c59fb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:05.774533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e737-adf0-46d3-b5eb-599a520c59fb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:05.797349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7ddc7a6b-a369-4151-bf76-a6b5ed2478dd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.798623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7ddc7a6b-a369-4151-bf76-a6b5ed2478dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.800230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bb58e-335d-448b-ae36-2381f18b8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:05.800898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb58e-335d-448b-ae36-2381f18b8d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.801182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb58e-335d-448b-ae36-2381f18b8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.801484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb58e-335d-448b-ae36-2381f18b8d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.802216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bb58e-335d-448b-ae36-2381f18b8d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:05.803905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bb58e-335d-448b-ae36-2381f18b8d3a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:05.829271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 771/1547] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.830620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07861dca-82d2-4b34-9a90-c4a315fffa31 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.830912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07861dca-82d2-4b34-9a90-c4a315fffa31 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.831259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07861dca-82d2-4b34-9a90-c4a315fffa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.837842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 776/1547] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:05.839362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4292d-be35-471b-ac2c-11e8a098c145 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.839636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4292d-be35-471b-ac2c-11e8a098c145 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.839916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4292d-be35-471b-ac2c-11e8a098c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.881111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-07861dca-82d2-4b34-9a90-c4a315fffa31 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.882366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-07861dca-82d2-4b34-9a90-c4a315fffa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.889898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a8e4292d-be35-471b-ac2c-11e8a098c145 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.891520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a8e4292d-be35-471b-ac2c-11e8a098c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.902935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 777/1548] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.904732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4292d-be35-471b-ac2c-11e8a098c145 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:05.906318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 772/1549] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.912595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7e20-0580-4b02-b78a-b2c01af4ef43 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.913155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7e20-0580-4b02-b78a-b2c01af4ef43 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.913684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7e20-0580-4b02-b78a-b2c01af4ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.922511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4292d-be35-471b-ac2c-11e8a098c145 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:05.937017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9579ca4-da19-46ae-8147-70f79b38fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:05.938068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9579ca4-da19-46ae-8147-70f79b38fc3b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.938777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9579ca4-da19-46ae-8147-70f79b38fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.939269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9579ca4-da19-46ae-8147-70f79b38fc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.940201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9579ca4-da19-46ae-8147-70f79b38fc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:05.942157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9579ca4-da19-46ae-8147-70f79b38fc3b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:05.950864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-034c7e20-0580-4b02-b78a-b2c01af4ef43 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.952635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-034c7e20-0580-4b02-b78a-b2c01af4ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.958519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 778/1550] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:05.960452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1af0-d4f1-47f2-b137-bd51f34fdeac None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.960858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1af0-d4f1-47f2-b137-bd51f34fdeac None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.961236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1af0-d4f1-47f2-b137-bd51f34fdeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.962663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 773/1551] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.963651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7e20-0580-4b02-b78a-b2c01af4ef43 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:05.975207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7e20-0580-4b02-b78a-b2c01af4ef43 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:05.982624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-905d1af0-d4f1-47f2-b137-bd51f34fdeac None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:05.983385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:05.983892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-905d1af0-d4f1-47f2-b137-bd51f34fdeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:05.984489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:05.985052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:05.985904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:05.987565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:05.988222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:05.991354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:32:05.991354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Jul 29 08:32:05.991354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: Jul 29 08:32:05.992839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc58f7-400e-431e-b6a4-9bae617a9e92 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:05.995414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 779/1552] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:05.996784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535d8be-a661-4d27-bb59-12dbd9ec75ac None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.000746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535d8be-a661-4d27-bb59-12dbd9ec75ac None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.000746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535d8be-a661-4d27-bb59-12dbd9ec75ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.007942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 774/1553] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:06.015392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5268f8-80e0-495b-9235-d502255439a7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.015392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5268f8-80e0-495b-9235-d502255439a7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.015392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5268f8-80e0-495b-9235-d502255439a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.022783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c535d8be-a661-4d27-bb59-12dbd9ec75ac None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.023920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c535d8be-a661-4d27-bb59-12dbd9ec75ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.033203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 780/1554] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.034275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535d8be-a661-4d27-bb59-12dbd9ec75ac None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.038310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2a5268f8-80e0-495b-9235-d502255439a7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.040055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2a5268f8-80e0-495b-9235-d502255439a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.047106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535d8be-a661-4d27-bb59-12dbd9ec75ac None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.055232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 775/1555] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.055232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5268f8-80e0-495b-9235-d502255439a7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.060067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1285ee-f403-4e08-8928-7cf5d4a4c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.060767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1285ee-f403-4e08-8928-7cf5d4a4c781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.061044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1285ee-f403-4e08-8928-7cf5d4a4c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.061347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1285ee-f403-4e08-8928-7cf5d4a4c781 admin admin] PATH_INFO: `/v3/projects/8cea9407070a44bb8248459a8e28b3f3/users/de146814ac4e4737950e864b5829b5fd/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.068014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5268f8-80e0-495b-9235-d502255439a7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.073486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22347926-04dc-4a3c-bad3-f23e3b695333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.074120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347926-04dc-4a3c-bad3-f23e3b695333 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.074403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347926-04dc-4a3c-bad3-f23e3b695333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.074677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347926-04dc-4a3c-bad3-f23e3b695333 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.075412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22347926-04dc-4a3c-bad3-f23e3b695333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:06.075781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22347926-04dc-4a3c-bad3-f23e3b695333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.076983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1285ee-f403-4e08-8928-7cf5d4a4c781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cea9407070a44bb8248459a8e28b3f3, user_id=de146814ac4e4737950e864b5829b5fd, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.077369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22347926-04dc-4a3c-bad3-f23e3b695333 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.078107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-9d1285ee-f403-4e08-8928-7cf5d4a4c781 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:32:06.078107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:32:06.078107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:32:06.080538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1285ee-f403-4e08-8928-7cf5d4a4c781 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.090952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 776/1556] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:06.092191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819cc0-7b91-4185-8b7e-dd312d91adfb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.092482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819cc0-7b91-4185-8b7e-dd312d91adfb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.092760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819cc0-7b91-4185-8b7e-dd312d91adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.095179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 781/1557] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:06 2022] PUT /identity/v3/projects/8cea9407070a44bb8248459a8e28b3f3/users/de146814ac4e4737950e864b5829b5fd/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:06.096647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53956-550a-4b27-af0e-6534f34c3a44 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.097606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53956-550a-4b27-af0e-6534f34c3a44 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.098064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53956-550a-4b27-af0e-6534f34c3a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.119940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-66819cc0-7b91-4185-8b7e-dd312d91adfb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.120178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6fd53956-550a-4b27-af0e-6534f34c3a44 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.121168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-66819cc0-7b91-4185-8b7e-dd312d91adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.121303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6fd53956-550a-4b27-af0e-6534f34c3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.175424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.185328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 777/1558] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.186253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819cc0-7b91-4185-8b7e-dd312d91adfb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.186386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 782/1559] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.187133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53956-550a-4b27-af0e-6534f34c3a44 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.201733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53956-550a-4b27-af0e-6534f34c3a44 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.202142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819cc0-7b91-4185-8b7e-dd312d91adfb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.206720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2402fcb-7cfd-43ec-b49f-86746cd3689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.207005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198551a-e587-453d-8f84-942b1de89b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.207912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2402fcb-7cfd-43ec-b49f-86746cd3689f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.208086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198551a-e587-453d-8f84-942b1de89b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.208254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198551a-e587-453d-8f84-942b1de89b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.208409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2402fcb-7cfd-43ec-b49f-86746cd3689f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.208507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198551a-e587-453d-8f84-942b1de89b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.208842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2402fcb-7cfd-43ec-b49f-86746cd3689f admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.209181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198551a-e587-453d-8f84-942b1de89b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.209774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2402fcb-7cfd-43ec-b49f-86746cd3689f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:06.210267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2402fcb-7cfd-43ec-b49f-86746cd3689f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.211137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198551a-e587-453d-8f84-942b1de89b23 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.212124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2402fcb-7cfd-43ec-b49f-86746cd3689f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.224453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 783/1560] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:06.225870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d6c8e-bdd8-4330-ac1b-a1924eb0dfb1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.226271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d6c8e-bdd8-4330-ac1b-a1924eb0dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.226619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d6c8e-bdd8-4330-ac1b-a1924eb0dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.238393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.245569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 778/1561] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.245569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a3ed-bc5f-4eaa-91db-547f092cd25d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.245569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a3ed-bc5f-4eaa-91db-547f092cd25d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.245569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a3ed-bc5f-4eaa-91db-547f092cd25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.256551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-690d6c8e-bdd8-4330-ac1b-a1924eb0dfb1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.257813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-690d6c8e-bdd8-4330-ac1b-a1924eb0dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.265389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-30f8a3ed-bc5f-4eaa-91db-547f092cd25d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.266583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-30f8a3ed-bc5f-4eaa-91db-547f092cd25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.324144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 784/1562] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.326932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25917301-2369-4038-9868-908ed449cb89 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.327317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25917301-2369-4038-9868-908ed449cb89 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.327604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25917301-2369-4038-9868-908ed449cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.328572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 779/1563] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.333102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8a3ed-bc5f-4eaa-91db-547f092cd25d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.339570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8a3ed-bc5f-4eaa-91db-547f092cd25d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.344463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085417fd-407f-41b2-83eb-70418dd2270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.345081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085417fd-407f-41b2-83eb-70418dd2270b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.345395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085417fd-407f-41b2-83eb-70418dd2270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.345680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085417fd-407f-41b2-83eb-70418dd2270b admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.346348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085417fd-407f-41b2-83eb-70418dd2270b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.348328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085417fd-407f-41b2-83eb-70418dd2270b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.356328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-25917301-2369-4038-9868-908ed449cb89 None None] MFA Rules not processed for user `de146814ac4e4737950e864b5829b5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.357571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25917301-2369-4038-9868-908ed449cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.379036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 780/1564] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.380721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306f8b-2f86-45da-936c-708bc93a7583 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.381013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306f8b-2f86-45da-936c-708bc93a7583 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.381372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306f8b-2f86-45da-936c-708bc93a7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.400364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e3306f8b-2f86-45da-936c-708bc93a7583 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.401606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e3306f8b-2f86-45da-936c-708bc93a7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.427994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 785/1565] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.429189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25917301-2369-4038-9868-908ed449cb89 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.444563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25917301-2369-4038-9868-908ed449cb89 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.476798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 781/1566] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.476798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3306f8b-2f86-45da-936c-708bc93a7583 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.485063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3306f8b-2f86-45da-936c-708bc93a7583 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.493529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.494329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.494616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.494919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.495599 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.497569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.512066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec4788-3097-4be3-805f-94499bb17c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.512708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec4788-3097-4be3-805f-94499bb17c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.513007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec4788-3097-4be3-805f-94499bb17c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.513272 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec4788-3097-4be3-805f-94499bb17c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.514031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec4788-3097-4be3-805f-94499bb17c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:06.514338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec4788-3097-4be3-805f-94499bb17c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.516403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec4788-3097-4be3-805f-94499bb17c4c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.527032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 782/1567] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.527667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.531711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 786/1568] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:06.533663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e846cb8-ed8e-479a-ac68-3e42268abb1a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.534016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e846cb8-ed8e-479a-ac68-3e42268abb1a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.534265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e846cb8-ed8e-479a-ac68-3e42268abb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.553682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e846cb8-ed8e-479a-ac68-3e42268abb1a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.554906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e846cb8-ed8e-479a-ac68-3e42268abb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.566271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.576214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.589966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5557d-69bf-4178-915c-03f8aadb75ac admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.594612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.595238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.595519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.595796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.596469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.598473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.618026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 787/1569] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.623436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 783/1570] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.623436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.623671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e846cb8-ed8e-479a-ac68-3e42268abb1a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.631792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5a179-036f-419f-888d-b1eb035ae1ce admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.632182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e846cb8-ed8e-479a-ac68-3e42268abb1a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.636470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.636808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194d9b0-d710-4599-afdb-b4f9b973f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.637083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.637402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.637538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194d9b0-d710-4599-afdb-b4f9b973f366 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.637687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.637851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194d9b0-d710-4599-afdb-b4f9b973f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.638012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194d9b0-d710-4599-afdb-b4f9b973f366 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.638354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.638719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194d9b0-d710-4599-afdb-b4f9b973f366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:06.639028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194d9b0-d710-4599-afdb-b4f9b973f366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.640300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.640613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194d9b0-d710-4599-afdb-b4f9b973f366 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.653303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 788/1571] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:06.654798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee14931-28c7-4137-b8de-2b5a7b9a4a83 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.655094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee14931-28c7-4137-b8de-2b5a7b9a4a83 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.655374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee14931-28c7-4137-b8de-2b5a7b9a4a83 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.656748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 789/1572] 10.222.0.47 () {54 vars in 962 bytes} [Fri Jul 29 08:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:06.657268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee14931-28c7-4137-b8de-2b5a7b9a4a83 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.669877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 784/1573] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.670182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.676268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee14931-28c7-4137-b8de-2b5a7b9a4a83 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.680080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce71a1-db88-4b13-a797-ac5ab975f5b0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.680872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.681536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.681819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.682123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.682896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:06.683153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.684755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.684905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.685416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.685697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.685969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.686640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.688566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.697449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 790/1574] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:06.698253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.710912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329c69f-4d20-4008-acfb-eefb0f26ef71 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.715800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.716532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.716887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.717230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.717991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.721476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 785/1575] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.721635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:32:06.721635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:32:06.721635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:32:06.721983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.722086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.730272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f17f57-9d3c-41b3-8df3-3d94e56317f5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.735783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9879f49-e9a8-426a-b3ce-ad4ea3b44e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.736404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9879f49-e9a8-426a-b3ce-ad4ea3b44e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.736690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9879f49-e9a8-426a-b3ce-ad4ea3b44e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.736987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9879f49-e9a8-426a-b3ce-ad4ea3b44e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.737707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9879f49-e9a8-426a-b3ce-ad4ea3b44e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:06.738011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9879f49-e9a8-426a-b3ce-ad4ea3b44e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.739734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9879f49-e9a8-426a-b3ce-ad4ea3b44e4b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.750607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 791/1576] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.750607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.759150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 786/1577] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:06.759150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db7f6-bbce-489e-8819-1e3fe5f6dee6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.759150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db7f6-bbce-489e-8819-1e3fe5f6dee6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.759150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db7f6-bbce-489e-8819-1e3fe5f6dee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.792722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bf9db7f6-bbce-489e-8819-1e3fe5f6dee6 None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:06.794316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bf9db7f6-bbce-489e-8819-1e3fe5f6dee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:06.812522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348dcc-d96b-4717-a1fc-286caf5cbf49 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.817500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.818123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.818401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.818677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.819372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.821097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.831009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 792/1578] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:06.831782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.843709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2965-4d6e-4a95-a669-37bd5bb6a651 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.848422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.849018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.849310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.849596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.850262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.852132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.862579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 787/1579] 10.222.0.47 () {58 vars in 1059 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:06.863857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db7f6-bbce-489e-8819-1e3fe5f6dee6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.874438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db7f6-bbce-489e-8819-1e3fe5f6dee6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.879197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.879879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.880160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.880430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.884016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 793/1580] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.884151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.884267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.884362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.893399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 788/1581] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:06.897225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.907311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f876-076c-4462-b220-c9ab1c326323 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.934036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.946219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3adcd-ef12-4c6c-9599-28b8720531ed admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:06.950301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.951423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.952049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.952382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.952667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.953376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.955316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.969613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:06.970496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:06.970866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:06.971200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:06.972047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:06.974277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:06.983590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 794/1582] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:06.984632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.987421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 789/1583] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:06.988278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:06.998615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513a975-2b68-497d-b462-670eda1ac7a6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.047434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c676cf-03ef-4e22-bc36-a111fe907021 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.052504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.053230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.053667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.054021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.054774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.055560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.056615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.056842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.057110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.057613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.058839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.062091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.079762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 795/1584] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:07.080988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.092261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b395fd-3091-4b57-8ce5-c16bb2d80094 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.095415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 790/1585] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:06 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:07.096199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.098018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.098884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.099063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.099347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.100046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.101696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.112222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 796/1586] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.116396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.125820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318a813-18f9-4661-9735-3b5aa0076f75 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.164105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7ab6-fa0e-45ee-83c2-524f562a196b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.170519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.171145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.171429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.171703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.182103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.182732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.183020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.183299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.183968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.185973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.210669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 797/1587] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:07 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:07.211739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.222920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f305afe-dd49-4271-a2ef-961c3fc111c4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.228203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.228823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.229109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.229420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.230160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.231792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.234313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.236386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.242814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 798/1588] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.246214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.247387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 791/1589] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:07.247924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.253366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7c07-7077-45a0-ab86-6870b3b6efa1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.254172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.259815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.260005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dd10e-af14-4f17-ba81-49341f9ec1ef service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.261671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.262093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.262513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.263853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.266402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.266737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.267147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.267496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.267838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.268645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.270353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.281950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 792/1590] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.283011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.293439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ef95-6b2b-4f41-8646-38e220b9abf9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.293844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 799/1591] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:07 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:07.294958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.298646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.299394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.299980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.300190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.300962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.302704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.305914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db7c32-8702-47d9-9f28-f051deb8dbf8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.311267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.311950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.312321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.312662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.313431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.314001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 793/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.314816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.316021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.324882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c0a7d-4428-4f37-a15e-a46f38c1798a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.330852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.331701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.332055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.332706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] PATH_INFO: `/v3/projects/b4e7b611334347d3aa5ba3ce972a9dcc/users/b8310ac5940945e1bb32d91834459ddc/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.333570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.340843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 800/1593] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:07 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:07.341915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.350409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e7b611334347d3aa5ba3ce972a9dcc, user_id=b8310ac5940945e1bb32d91834459ddc, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.352356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cc90a-efce-4326-815b-dc67d900e258 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.353664 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.357029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.357675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.357962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.358244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.358963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.360540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.370517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 794/1594] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:07 2022] PUT /identity/v3/projects/b4e7b611334347d3aa5ba3ce972a9dcc/users/b8310ac5940945e1bb32d91834459ddc/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:07.371612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.375176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 801/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.378511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.388443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ee9a-bf33-4d37-96cc-2a8c23973877 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.438508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04731245-1622-4b21-8adc-15e6fff68dee admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.443552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.444032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.444242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.444530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.444812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] PATH_INFO: `/v3/projects/964dba76d9704a47b4c48e55c9b0702f/users/35725724ab3d4148858c7f9cded65484/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.445387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.445838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.446108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] PATH_INFO: `/v3/projects/f46dbaa53abe4a97a661415eb8b3c362/users/b4609a19bb8a4bd0aacf6af1740f4e81/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.459842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964dba76d9704a47b4c48e55c9b0702f, user_id=35725724ab3d4148858c7f9cded65484, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.462521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46dbaa53abe4a97a661415eb8b3c362, user_id=b4609a19bb8a4bd0aacf6af1740f4e81, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.462658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.466751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.486844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 802/1596] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:07 2022] PUT /identity/v3/projects/964dba76d9704a47b4c48e55c9b0702f/users/35725724ab3d4148858c7f9cded65484/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:07.487456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 795/1597] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:07 2022] PUT /identity/v3/projects/f46dbaa53abe4a97a661415eb8b3c362/users/b4609a19bb8a4bd0aacf6af1740f4e81/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:07.488149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.488309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.560058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7fa17-4c02-485b-bab7-b9e03a4ff367 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.562669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c04ee-d75a-49d9-ad47-c212a771c375 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.565162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.565980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.566268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.566579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.567351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.567706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c0bab-0c89-4eb2-bbb0-affe7404b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.568333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c0bab-0c89-4eb2-bbb0-affe7404b05a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.568624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c0bab-0c89-4eb2-bbb0-affe7404b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.568893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c0bab-0c89-4eb2-bbb0-affe7404b05a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.569002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.569620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c0bab-0c89-4eb2-bbb0-affe7404b05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.571217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c0bab-0c89-4eb2-bbb0-affe7404b05a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.579869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 796/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.580925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.585382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 803/1599] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.585382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72485-e8ed-41ed-bab9-798f8a40b527 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.585800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72485-e8ed-41ed-bab9-798f8a40b527 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.586092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72485-e8ed-41ed-bab9-798f8a40b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.595446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11ae5-6636-4b05-b302-75df5ba8f2b5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.600371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.601078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.601646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.601646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.602400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.604145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.607277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b0c72485-e8ed-41ed-bab9-798f8a40b527 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:07.608493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b0c72485-e8ed-41ed-bab9-798f8a40b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:07.615228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 797/1600] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.616086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.619740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 804/1601] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:07.620859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff79d7-e195-4e27-8dc8-15832edcd1dc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.621153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff79d7-e195-4e27-8dc8-15832edcd1dc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.621504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff79d7-e195-4e27-8dc8-15832edcd1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.627481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36c8e3-4856-450c-a517-ee95dc303f97 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.637241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9658ac-3d47-4bb1-a531-95486a7d3059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.637902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9658ac-3d47-4bb1-a531-95486a7d3059 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.638185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9658ac-3d47-4bb1-a531-95486a7d3059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.638463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9658ac-3d47-4bb1-a531-95486a7d3059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.639593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9658ac-3d47-4bb1-a531-95486a7d3059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.641214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9658ac-3d47-4bb1-a531-95486a7d3059 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.644462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b5ff79d7-e195-4e27-8dc8-15832edcd1dc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:07.645969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b5ff79d7-e195-4e27-8dc8-15832edcd1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:07.652649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 798/1602] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.653997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7471-05f1-49ba-aa08-136465b9bb7f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.654286 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7471-05f1-49ba-aa08-136465b9bb7f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.654560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7471-05f1-49ba-aa08-136465b9bb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.657825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 805/1603] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:07.659571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff79d7-e195-4e27-8dc8-15832edcd1dc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.670699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff79d7-e195-4e27-8dc8-15832edcd1dc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.676463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.677555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.677843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.678126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] PATH_INFO: `/v3/projects/bbc7d321336a45c9a2b4439f2d937788/users/5994250bbf40496cac124b5c558f6639/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.689074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.692448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-190d7471-05f1-49ba-aa08-136465b9bb7f None None] MFA Rules not processed for user `b4609a19bb8a4bd0aacf6af1740f4e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:07.694778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc7d321336a45c9a2b4439f2d937788, user_id=5994250bbf40496cac124b5c558f6639, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.695166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-190d7471-05f1-49ba-aa08-136465b9bb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:07.697898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.726576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 806/1604] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:07 2022] PUT /identity/v3/projects/bbc7d321336a45c9a2b4439f2d937788/users/5994250bbf40496cac124b5c558f6639/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:07.726576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.766795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 799/1605] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:07.767648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7471-05f1-49ba-aa08-136465b9bb7f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.775506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.780076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7471-05f1-49ba-aa08-136465b9bb7f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.813009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5f2d-0c0d-4ea8-926f-6f0f45afb87a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.818267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.818954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.819361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.819671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.820380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.822040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.833209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 807/1606] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.834041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.845300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.845948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.846240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.846515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.847283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.848898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.859096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 800/1607] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:07.860263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.870701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376c7b-55f3-4928-a027-d74096bec7b1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.875283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.875916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.876203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.876481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] PATH_INFO: `/v3/projects/636239acce3a43498e4f9ff4eea6fecb/users/0cdd089cc14c4198ab0c3c2cc7f996bf/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.891021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff21e-0766-4b59-80c9-7bcb77c79cc2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.892073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] RBAC: Authorizing `identity:create_grant(project_id=636239acce3a43498e4f9ff4eea6fecb, user_id=0cdd089cc14c4198ab0c3c2cc7f996bf, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.894788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a35cbe-0be7-4c9d-8b6c-b3775fd33338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.894933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.895436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35cbe-0be7-4c9d-8b6c-b3775fd33338 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.895689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35cbe-0be7-4c9d-8b6c-b3775fd33338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.895964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35cbe-0be7-4c9d-8b6c-b3775fd33338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.905092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a35cbe-0be7-4c9d-8b6c-b3775fd33338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:07.906563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a35cbe-0be7-4c9d-8b6c-b3775fd33338 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:07.909338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 801/1608] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:07 2022] PUT /identity/v3/projects/636239acce3a43498e4f9ff4eea6fecb/users/0cdd089cc14c4198ab0c3c2cc7f996bf/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:07.910158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:07.921596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 808/1609] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:07.923350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a2f1-5eea-4918-9c6f-ba51985ace0d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.923648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a2f1-5eea-4918-9c6f-ba51985ace0d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.924269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a2f1-5eea-4918-9c6f-ba51985ace0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:07.959531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a374a2f1-5eea-4918-9c6f-ba51985ace0d None None] MFA Rules not processed for user `5994250bbf40496cac124b5c558f6639`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:07.960881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a374a2f1-5eea-4918-9c6f-ba51985ace0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:07.972468 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ef3a-22fc-4eae-85dd-e716d36875da admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:07.976216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47de2b9-d769-482d-b6da-82429da1ab1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:07.976846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de2b9-d769-482d-b6da-82429da1ab1a service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:07.977128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de2b9-d769-482d-b6da-82429da1ab1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:07.977432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de2b9-d769-482d-b6da-82429da1ab1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.014782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:08.041621 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 809/1610] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:08.042675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374a2f1-5eea-4918-9c6f-ba51985ace0d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.056215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de2b9-d769-482d-b6da-82429da1ab1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.057801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de2b9-d769-482d-b6da-82429da1ab1a service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.072154 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 802/1611] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:08.073977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1081529-69f7-456e-9547-3abdb7dab3b7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.073977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1081529-69f7-456e-9547-3abdb7dab3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.074254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1081529-69f7-456e-9547-3abdb7dab3b7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.076050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 803/1612] 10.222.0.47 () {54 vars in 962 bytes} [Fri Jul 29 08:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:08.078271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1081529-69f7-456e-9547-3abdb7dab3b7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.095101 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1081529-69f7-456e-9547-3abdb7dab3b7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.100827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.101635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.101996 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.102357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] PATH_INFO: `/v3/projects/9189f8589b3a4b9fb33e3a5505160afa/users/5b6e13a14dd64724aaff936a6c1e3d3a/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.119072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9189f8589b3a4b9fb33e3a5505160afa, user_id=5b6e13a14dd64724aaff936a6c1e3d3a, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.119975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374a2f1-5eea-4918-9c6f-ba51985ace0d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.121891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.127324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3798c-bbf5-424e-94a3-f4dcb4924e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.130934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3798c-bbf5-424e-94a3-f4dcb4924e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.130934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3798c-bbf5-424e-94a3-f4dcb4924e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.130934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3798c-bbf5-424e-94a3-f4dcb4924e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.130934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3798c-bbf5-424e-94a3-f4dcb4924e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.132490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3798c-bbf5-424e-94a3-f4dcb4924e2d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.138366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:08.154526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 804/1613] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:08 2022] PUT /identity/v3/projects/9189f8589b3a4b9fb33e3a5505160afa/users/5b6e13a14dd64724aaff936a6c1e3d3a/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:08.154526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.166989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 810/1614] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:08.168682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190103ca-d82d-4be8-9565-8d41af92c8fe None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.168682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190103ca-d82d-4be8-9565-8d41af92c8fe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.168974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190103ca-d82d-4be8-9565-8d41af92c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.200437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-190103ca-d82d-4be8-9565-8d41af92c8fe None None] MFA Rules not processed for user `0cdd089cc14c4198ab0c3c2cc7f996bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:08.201740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-190103ca-d82d-4be8-9565-8d41af92c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:08.246961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16966-ca0b-4dcf-bb3f-1890e094d638 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.291112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 811/1615] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:08.295192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190103ca-d82d-4be8-9565-8d41af92c8fe None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.327796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93102d1a-629a-4711-8e05-a3476879e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.329428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102d1a-629a-4711-8e05-a3476879e1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.329979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102d1a-629a-4711-8e05-a3476879e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.330493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102d1a-629a-4711-8e05-a3476879e1a5 admin admin] PATH_INFO: `/v3/projects/92130ff938dc47098c93cbb3c2a2aa78/users/aa2ec2d66eba4da1895adbe39a7b2b76/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.373149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93102d1a-629a-4711-8e05-a3476879e1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92130ff938dc47098c93cbb3c2a2aa78, user_id=aa2ec2d66eba4da1895adbe39a7b2b76, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.376289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93102d1a-629a-4711-8e05-a3476879e1a5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.387099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190103ca-d82d-4be8-9565-8d41af92c8fe None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.395745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 805/1616] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:08 2022] PUT /identity/v3/projects/92130ff938dc47098c93cbb3c2a2aa78/users/aa2ec2d66eba4da1895adbe39a7b2b76/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:08.397806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdfb08-2e0d-46e0-b56b-9641e74f278b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.398644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdfb08-2e0d-46e0-b56b-9641e74f278b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.399044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdfb08-2e0d-46e0-b56b-9641e74f278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.428628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fbfdfb08-2e0d-46e0-b56b-9641e74f278b None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:08.430233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fbfdfb08-2e0d-46e0-b56b-9641e74f278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:08.493181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:08.514611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.515437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.515781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.516061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.516798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.518887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.580659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 806/1617] 10.222.0.47 () {58 vars in 1059 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:08.588551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049bb26-4740-49e4-a5e7-21572b6f5996 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.588938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049bb26-4740-49e4-a5e7-21572b6f5996 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.589335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049bb26-4740-49e4-a5e7-21572b6f5996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.596875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 812/1618] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/projects => generated 403 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:08.598437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.616648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:08.632775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a049bb26-4740-49e4-a5e7-21572b6f5996 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:08.635043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a049bb26-4740-49e4-a5e7-21572b6f5996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:08.687614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5741b05-0861-4ac1-9367-1118b88445fe admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.694052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.694894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.695250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.696262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.697148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.700032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.741345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 813/1619] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:08.744959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.752242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 807/1620] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:08.752242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ffce-6e7b-4886-9890-1e637927650c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.752242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ffce-6e7b-4886-9890-1e637927650c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.752242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ffce-6e7b-4886-9890-1e637927650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.781094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1e60ffce-6e7b-4886-9890-1e637927650c None None] MFA Rules not processed for user `aa2ec2d66eba4da1895adbe39a7b2b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:08.782502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1e60ffce-6e7b-4886-9890-1e637927650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:08.816566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981ffec-8945-4aa4-9af1-e78d9fd050e5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.822024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.823031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.824232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.824664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.878855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 808/1621] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:08.881009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06a2a5-4312-4499-a7f0-ddfc1107ddaa None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.881979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06a2a5-4312-4499-a7f0-ddfc1107ddaa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.882664 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06a2a5-4312-4499-a7f0-ddfc1107ddaa None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.893085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 809/1622] 10.222.0.47 () {54 vars in 912 bytes} [Fri Jul 29 08:32:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:08.894981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06a2a5-4312-4499-a7f0-ddfc1107ddaa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.913894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06a2a5-4312-4499-a7f0-ddfc1107ddaa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.922182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.923460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.923851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.924234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.925122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.925249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.927207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.927595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.939850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 814/1623] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:08.941222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.955394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed502f37-3aab-4803-8cc6-9fad4cc74bcb service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:08.963285 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:08.964243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:08.964507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:08.965464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:08.966230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:08.968765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:08.981393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 810/1624] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:08 2022] POST /identity/v3/users => generated 308 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:08.982856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:08.995917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 815/1625] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:08.996576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.071356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:09.083761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:09.104592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3a8a-89fd-4502-b353-9fcd9f978398 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.115530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fdb8c-2c42-447e-abbf-56a26e8b29aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.116836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdb8c-2c42-447e-abbf-56a26e8b29aa service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.118539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdb8c-2c42-447e-abbf-56a26e8b29aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.119179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdb8c-2c42-447e-abbf-56a26e8b29aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.130367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719064c-495a-4cc3-8192-d1d321713c94 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.136490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.137185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.140514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.140723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.143611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fdb8c-2c42-447e-abbf-56a26e8b29aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.145164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fdb8c-2c42-447e-abbf-56a26e8b29aa service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.153535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.155711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.160344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 811/1626] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:09.161877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede02ec-7842-485f-b54a-755afdbafe30 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.162240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede02ec-7842-485f-b54a-755afdbafe30 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.162585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede02ec-7842-485f-b54a-755afdbafe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.179094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 816/1627] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:09.180114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.192461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926611-4f2d-4ccc-8741-089f61984fe3 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.199969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.201526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.202306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.202611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.203704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.205494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.219577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 817/1628] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:09.220497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.227943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cede02ec-7842-485f-b54a-755afdbafe30 None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:09.229124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cede02ec-7842-485f-b54a-755afdbafe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:09.232340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb22b3f-ea30-4fe0-940a-8b1aff953ca3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.241028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30cf5-041c-4e10-b792-cd16e8b08cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.241908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30cf5-041c-4e10-b792-cd16e8b08cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.242297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30cf5-041c-4e10-b792-cd16e8b08cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.242674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30cf5-041c-4e10-b792-cd16e8b08cb7 admin admin] PATH_INFO: `/v3/projects/4406fdc6076149ddac62f856d74446f2/users/4e4fe7b6a7b64e6ebdb812d134702907/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.269401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 812/1629] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:32:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:09.270166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede02ec-7842-485f-b54a-755afdbafe30 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.293339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede02ec-7842-485f-b54a-755afdbafe30 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.308781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba30cf5-041c-4e10-b792-cd16e8b08cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4406fdc6076149ddac62f856d74446f2, user_id=4e4fe7b6a7b64e6ebdb812d134702907, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.309017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.309715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.310004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.310287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] PATH_INFO: `/v3/projects/7d650b61dc0045deb3c9fdd37160e2c1/users/7264085034d4445eb0a096bcc58a1505/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.318238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba30cf5-041c-4e10-b792-cd16e8b08cb7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.340235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d650b61dc0045deb3c9fdd37160e2c1, user_id=7264085034d4445eb0a096bcc58a1505, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.343097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.348505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 818/1630] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:09 2022] PUT /identity/v3/projects/4406fdc6076149ddac62f856d74446f2/users/4e4fe7b6a7b64e6ebdb812d134702907/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:09.353186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851dd43-6033-47e7-b858-babdecbb83c6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.355533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851dd43-6033-47e7-b858-babdecbb83c6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.355849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851dd43-6033-47e7-b858-babdecbb83c6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.359984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 819/1631] 10.222.0.47 () {54 vars in 912 bytes} [Fri Jul 29 08:32:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:09.362056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851dd43-6033-47e7-b858-babdecbb83c6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.375749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 813/1632] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:09 2022] PUT /identity/v3/projects/7d650b61dc0045deb3c9fdd37160e2c1/users/7264085034d4445eb0a096bcc58a1505/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:09.379593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.520322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851dd43-6033-47e7-b858-babdecbb83c6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.528467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.528756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3428f1-0d25-478e-9bca-e8026bd4d09c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.529575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.529983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.530355 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.541892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02f6dc-9736-47c9-9c5f-438e49ae8ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.542549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02f6dc-9736-47c9-9c5f-438e49ae8ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.542838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02f6dc-9736-47c9-9c5f-438e49ae8ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.543121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02f6dc-9736-47c9-9c5f-438e49ae8ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.544392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02f6dc-9736-47c9-9c5f-438e49ae8ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.546380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02f6dc-9736-47c9-9c5f-438e49ae8ae8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.579410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 814/1633] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:09.580905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7325b-e711-4a9d-8657-805e96de689a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.581267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7325b-e711-4a9d-8657-805e96de689a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.583700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7325b-e711-4a9d-8657-805e96de689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.632198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1fe7325b-e711-4a9d-8657-805e96de689a None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:09.635967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1fe7325b-e711-4a9d-8657-805e96de689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:09.644283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.645889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.658907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 820/1634] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:09.659972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.661592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 815/1635] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:32:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:09.671495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7325b-e711-4a9d-8657-805e96de689a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.673695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4ac5-f5e9-4f69-abd0-7c0ad3ffdc93 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.680471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.681367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.681750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.682153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.683056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.684990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.698195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 821/1636] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:09.702221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.703583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7325b-e711-4a9d-8657-805e96de689a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.714094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab793d-110e-488e-aef2-f2abcb55bd32 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:09.714490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fecba-48c0-4b36-be6e-03803ca9be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.715774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fecba-48c0-4b36-be6e-03803ca9be7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.716076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fecba-48c0-4b36-be6e-03803ca9be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.716366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fecba-48c0-4b36-be6e-03803ca9be7c admin admin] PATH_INFO: `/v3/projects/4406fdc6076149ddac62f856d74446f2/users/4e4fe7b6a7b64e6ebdb812d134702907/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.720646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0284046-dbf9-4d0c-a328-c445d43888cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:09.721954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0284046-dbf9-4d0c-a328-c445d43888cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.722961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fecba-48c0-4b36-be6e-03803ca9be7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4406fdc6076149ddac62f856d74446f2, user_id=4e4fe7b6a7b64e6ebdb812d134702907, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.723470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0284046-dbf9-4d0c-a328-c445d43888cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.723958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0284046-dbf9-4d0c-a328-c445d43888cf admin admin] PATH_INFO: `/v3/projects/7d650b61dc0045deb3c9fdd37160e2c1/users/7264085034d4445eb0a096bcc58a1505/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.726421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fecba-48c0-4b36-be6e-03803ca9be7c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.731560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0284046-dbf9-4d0c-a328-c445d43888cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d650b61dc0045deb3c9fdd37160e2c1, user_id=7264085034d4445eb0a096bcc58a1505, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:09.734841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0284046-dbf9-4d0c-a328-c445d43888cf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:09.759919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 816/1637] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:09 2022] PUT /identity/v3/projects/4406fdc6076149ddac62f856d74446f2/users/4e4fe7b6a7b64e6ebdb812d134702907/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:09.763123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4532d-6cc3-4026-b899-5909044acb0a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.763702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4532d-6cc3-4026-b899-5909044acb0a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.763702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4532d-6cc3-4026-b899-5909044acb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.792079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 822/1638] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:09 2022] PUT /identity/v3/projects/7d650b61dc0045deb3c9fdd37160e2c1/users/7264085034d4445eb0a096bcc58a1505/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:09.801482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5ffc7-3781-4782-a44c-ee3b8b0c90e2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:09.801784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5ffc7-3781-4782-a44c-ee3b8b0c90e2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:09.802503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5ffc7-3781-4782-a44c-ee3b8b0c90e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:09.836419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-08c4532d-6cc3-4026-b899-5909044acb0a None None] MFA Rules not processed for user `4e4fe7b6a7b64e6ebdb812d134702907`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:09.839187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-08c4532d-6cc3-4026-b899-5909044acb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:09.840311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:09.894105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-94e5ffc7-3781-4782-a44c-ee3b8b0c90e2 None None] MFA Rules not processed for user `7264085034d4445eb0a096bcc58a1505`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:09.896163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-94e5ffc7-3781-4782-a44c-ee3b8b0c90e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:09.961610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 817/1639] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:32:09.962441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4532d-6cc3-4026-b899-5909044acb0a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:09.975950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:10.104014 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 823/1640] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:10.115845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4532d-6cc3-4026-b899-5909044acb0a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:10.121077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:10.121969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:10.122440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:10.134360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5ffc7-3781-4782-a44c-ee3b8b0c90e2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:10.146020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:10.150443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5ffc7-3781-4782-a44c-ee3b8b0c90e2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:10.174283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:10.174992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:10.175363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:10.175707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:10.209205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:10.211361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:10.303088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 824/1641] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:10.341746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:10.347247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:10.379795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 818/1642] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:10.472069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:10.500240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0d768-f1d6-4184-b260-9bd82a8ac78c service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:10.522232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:10.523210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:10.523629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:10.524016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:10.544032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:10.545980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:10.561523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 825/1643] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:10.687490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:10.834853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:10.848082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355d4ee-6a3e-48d8-a620-5e0172243fa8 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:10.860888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b260550-7b02-4659-9588-381ed617bac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:10.864068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260550-7b02-4659-9588-381ed617bac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:10.864389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260550-7b02-4659-9588-381ed617bac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:10.865904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260550-7b02-4659-9588-381ed617bac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:10.966354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580315df-9797-4fd4-91eb-16785c2fdb74 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:10.984701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:10.985698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:10.985983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:10.986264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] PATH_INFO: `/v3/users/de146814ac4e4737950e864b5829b5fd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:10.992015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de146814ac4e4737950e864b5829b5fd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:10.997367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:11.092071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b260550-7b02-4659-9588-381ed617bac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:11.093303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b260550-7b02-4659-9588-381ed617bac3 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:11.129801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 826/1644] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:11.202131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de146814ac4e4737950e864b5829b5fd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.214646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:11.219814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de146814ac4e4737950e864b5829b5fd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.246251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de146814ac4e4737950e864b5829b5fd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.286589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de146814ac4e4737950e864b5829b5fd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.287885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de146814ac4e4737950e864b5829b5fd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.314034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 819/1645] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:10 2022] DELETE /identity/v3/users/de146814ac4e4737950e864b5829b5fd => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:11.318672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:11.319037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:11.319387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:11.362860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:11.364112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:11.500784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:11.503507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:11.558683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 827/1646] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:11.624578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c86c-6855-4693-8b8f-e20f7ff9faa8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:11.632274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:11.633772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:11.638823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:11.640086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:11.640414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:11.640694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] PATH_INFO: `/v3/users/5994250bbf40496cac124b5c558f6639` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:11.644485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5994250bbf40496cac124b5c558f6639)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:11.646499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:11.647894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:11.735268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5994250bbf40496cac124b5c558f6639'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.748362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5994250bbf40496cac124b5c558f6639'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.767028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08d84-8213-4272-a24f-0460a3c5f569 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:11.771535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416304ad-a2f2-4bb0-a6a3-0a8e297a3742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:11.772231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416304ad-a2f2-4bb0-a6a3-0a8e297a3742 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:11.772525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416304ad-a2f2-4bb0-a6a3-0a8e297a3742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:11.772941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416304ad-a2f2-4bb0-a6a3-0a8e297a3742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:11.775544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5994250bbf40496cac124b5c558f6639'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.798739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416304ad-a2f2-4bb0-a6a3-0a8e297a3742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:11.800309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416304ad-a2f2-4bb0-a6a3-0a8e297a3742 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:11.803695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5994250bbf40496cac124b5c558f6639'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.805120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5994250bbf40496cac124b5c558f6639'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:11.813060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 828/1647] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:11.822226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 820/1648] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:11 2022] DELETE /identity/v3/users/5994250bbf40496cac124b5c558f6639 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:11.825316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:11.825684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:11.826093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:11.859645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:11.860889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:11.992386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 829/1649] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:12.040177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:12.041846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:12.155474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:12.192629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae52a-39bf-412f-9753-4cb8cbb8ea70 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:12.192629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd5e6d-c89f-493d-8bce-5c6b0da0ddc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:12.192629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd5e6d-c89f-493d-8bce-5c6b0da0ddc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:12.192629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd5e6d-c89f-493d-8bce-5c6b0da0ddc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:12.193400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd5e6d-c89f-493d-8bce-5c6b0da0ddc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:12.202706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd5e6d-c89f-493d-8bce-5c6b0da0ddc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:12.204888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd5e6d-c89f-493d-8bce-5c6b0da0ddc9 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:12.240706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 821/1650] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:13.102315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:13.103800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:13.134828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671133d-4519-4da3-aa20-b0c49ffec22c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:13.147993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:13.148680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:13.148965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:13.149304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] PATH_INFO: `/v3/projects/8cea9407070a44bb8248459a8e28b3f3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:13.152487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cea9407070a44bb8248459a8e28b3f3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:13.154900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:13.304386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cea9407070a44bb8248459a8e28b3f3', 'request_id': 'req-18ad42a3-db16-448a-8519-8c60f691fa4c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:13.305784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cea9407070a44bb8248459a8e28b3f3', 'request_id': 'req-18ad42a3-db16-448a-8519-8c60f691fa4c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:13.328140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cea9407070a44bb8248459a8e28b3f3', 'request_id': 'req-18ad42a3-db16-448a-8519-8c60f691fa4c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:13.367093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] The token cache is being invalidate because project 8cea9407070a44bb8248459a8e28b3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:13.367473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:13.368262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-18ad42a3-db16-448a-8519-8c60f691fa4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:13.371472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 830/1651] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:13 2022] DELETE /identity/v3/projects/8cea9407070a44bb8248459a8e28b3f3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:13.381893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72b6ae-b1ee-423f-977d-36bb630b4124 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:13.382974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72b6ae-b1ee-423f-977d-36bb630b4124 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:13.383390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72b6ae-b1ee-423f-977d-36bb630b4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:13.426146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6c72b6ae-b1ee-423f-977d-36bb630b4124 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:13.427850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6c72b6ae-b1ee-423f-977d-36bb630b4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:13.524648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 822/1652] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:13.526857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c252d-658a-4ae9-a172-5d8300a5c099 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:13.527038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c252d-658a-4ae9-a172-5d8300a5c099 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:13.527324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c252d-658a-4ae9-a172-5d8300a5c099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:13.562512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-323c252d-658a-4ae9-a172-5d8300a5c099 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:13.567029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-323c252d-658a-4ae9-a172-5d8300a5c099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:13.592336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72b6ae-b1ee-423f-977d-36bb630b4124 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:13.592543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 831/1653] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:13.609709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72b6ae-b1ee-423f-977d-36bb630b4124 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:13.628464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:13.629202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:13.629540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:13.629831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:13.630443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:13.630833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:13.632382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:13.666020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 823/1654] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:32:13.671098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c252d-658a-4ae9-a172-5d8300a5c099 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:13.708003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c252d-658a-4ae9-a172-5d8300a5c099 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:13.727322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:13.728322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:13.729113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:13.730221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:13.730631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:13.731930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:13.733985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:13.738438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:13.757585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f472c87-c445-4cf6-84a0-46323fdf72cc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:13.771853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:13.772978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:13.773465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:13.773918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] PATH_INFO: `/v3/projects/bbc7d321336a45c9a2b4439f2d937788` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:13.780988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc7d321336a45c9a2b4439f2d937788)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:13.782598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:32:13.782598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Jul 29 08:32:13.782598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: Jul 29 08:32:13.783931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:13.839181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 832/1655] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:13 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:13.841676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:13.857001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:13.938067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc7d321336a45c9a2b4439f2d937788', 'request_id': 'req-d5c3aac1-3c1e-4839-815c-67fcc39012ef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:13.946261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc7d321336a45c9a2b4439f2d937788', 'request_id': 'req-d5c3aac1-3c1e-4839-815c-67fcc39012ef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:13.959959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc7d321336a45c9a2b4439f2d937788', 'request_id': 'req-d5c3aac1-3c1e-4839-815c-67fcc39012ef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.001143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] The token cache is being invalidate because project bbc7d321336a45c9a2b4439f2d937788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:14.001896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.003460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.006009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 824/1656] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:13 2022] DELETE /identity/v3/projects/bbc7d321336a45c9a2b4439f2d937788 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:14.016809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:14.018816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:14.031564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8847bba-6a21-4e0c-a059-82cedb33aee3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:14.179853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3aac1-3c1e-4839-815c-67fcc39012ef admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:14.189758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:14.190842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:14.192997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:14.193494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] PATH_INFO: `/v3/users/7264085034d4445eb0a096bcc58a1505` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:14.203168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7264085034d4445eb0a096bcc58a1505)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:14.209489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:14.210147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:14.210642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:14.211106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:14.212268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:14.213749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:14.214731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:14.221361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:14.267804 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 833/1657] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:13 2022] POST /identity/v3/users => generated 283 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:14.272010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:14.276047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:14.325869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d1631-627c-43a8-a2fe-c7dbeb724052 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:14.343186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:14.343702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:14.344517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:14.346483 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:14.348038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:14.354201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:14.387835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7264085034d4445eb0a096bcc58a1505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.400995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 834/1658] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:14.404570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7264085034d4445eb0a096bcc58a1505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.405184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:14.421758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66048-55e1-4879-ba51-91d34ccd7f6e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:14.428445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7264085034d4445eb0a096bcc58a1505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.440559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8a1c7-02a9-4738-8714-3ae1062e1120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:14.441801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a1c7-02a9-4738-8714-3ae1062e1120 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:14.442320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a1c7-02a9-4738-8714-3ae1062e1120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:14.442814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a1c7-02a9-4738-8714-3ae1062e1120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:14.443767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8a1c7-02a9-4738-8714-3ae1062e1120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:14.445666 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8a1c7-02a9-4738-8714-3ae1062e1120 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:14.454172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7264085034d4445eb0a096bcc58a1505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.454954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7264085034d4445eb0a096bcc58a1505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:14.473511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 825/1659] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:14 2022] DELETE /identity/v3/users/7264085034d4445eb0a096bcc58a1505 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:14.474831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:14.475217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 835/1660] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:14.479065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:14.557239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5635cde-8d44-46cd-a52d-f10ed4012809 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:14.563106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:14.563818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:14.564102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:14.564384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] PATH_INFO: `/v3/projects/36055274d1a64258a5338b00435d45ce/users/5c4e02455e414537ab3e9b0539a505a5/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:14.592157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36055274d1a64258a5338b00435d45ce, user_id=5c4e02455e414537ab3e9b0539a505a5, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:14.595134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:14.625883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 826/1661] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:14 2022] PUT /identity/v3/projects/36055274d1a64258a5338b00435d45ce/users/5c4e02455e414537ab3e9b0539a505a5/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:14.627764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904ece-2de9-4317-b9bd-c98499da53ab None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:14.627764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904ece-2de9-4317-b9bd-c98499da53ab None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:14.628351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904ece-2de9-4317-b9bd-c98499da53ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:14.681975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c2904ece-2de9-4317-b9bd-c98499da53ab None None] MFA Rules not processed for user `5c4e02455e414537ab3e9b0539a505a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:14.683134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c2904ece-2de9-4317-b9bd-c98499da53ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:14.820082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 836/1662] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:14.824381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:14.927208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac08a0-1b7b-4e43-b77c-49c0512eaa09 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:14.933414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:14.934595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:14.935429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:14.935972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:14.936877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:14.940027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:14.976724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:15.022367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 827/1663] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:14 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:15.024018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904ece-2de9-4317-b9bd-c98499da53ab None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:15.046361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904ece-2de9-4317-b9bd-c98499da53ab None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:15.064683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:15.148393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:15.150220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:15.282029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:15.282695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:15.282988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:15.283270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:15.284032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:15.291462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:15.341454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 837/1664] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:15 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:32:15.345849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:15.349161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ccc7c-bf0b-4dea-8bf4-08d424923fe5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:15.356646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:15.357407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:15.357698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:15.357975 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] PATH_INFO: `/v3/projects/7d650b61dc0045deb3c9fdd37160e2c1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:15.359197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d650b61dc0045deb3c9fdd37160e2c1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:15.361316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:15.363898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794f161-f177-4fe6-b2cc-2cf354cd00f0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:15.380764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:15.381613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:15.382036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:15.382475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:15.383346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:15.385236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:15.414770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 838/1665] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:15.419438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:15.441470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f86c3-65e0-4f58-8bd6-54484c479f8a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:15.460859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d650b61dc0045deb3c9fdd37160e2c1', 'request_id': 'req-248e6215-532d-4f24-92f1-b3a2257663f0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:15.483533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d650b61dc0045deb3c9fdd37160e2c1', 'request_id': 'req-248e6215-532d-4f24-92f1-b3a2257663f0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:15.506168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d650b61dc0045deb3c9fdd37160e2c1', 'request_id': 'req-248e6215-532d-4f24-92f1-b3a2257663f0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:15.574563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] The token cache is being invalidate because project 7d650b61dc0045deb3c9fdd37160e2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:15.575608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:15.575957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-248e6215-532d-4f24-92f1-b3a2257663f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:15.583473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 828/1666] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:15 2022] DELETE /identity/v3/projects/7d650b61dc0045deb3c9fdd37160e2c1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:15.585133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251c734-8db3-4f70-bbc7-80f5fe91590e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:15.585569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251c734-8db3-4f70-bbc7-80f5fe91590e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:15.585854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251c734-8db3-4f70-bbc7-80f5fe91590e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:15.626325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a251c734-8db3-4f70-bbc7-80f5fe91590e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:15.628235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a251c734-8db3-4f70-bbc7-80f5fe91590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:15.661084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:15.661833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:15.662121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:15.662405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] PATH_INFO: `/v3/projects/c5936850bc9445079a3af504e21b23b7/users/6fdc9528fe8442cab760eb85fb92e2f4/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:15.698034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5936850bc9445079a3af504e21b23b7, user_id=6fdc9528fe8442cab760eb85fb92e2f4, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:15.702587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:15.739638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 839/1667] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:15 2022] PUT /identity/v3/projects/c5936850bc9445079a3af504e21b23b7/users/6fdc9528fe8442cab760eb85fb92e2f4/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:15.743849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:15.747800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:15.797724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 829/1668] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:15.807130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc80a0-2e86-4f7e-ab01-348bfc8f2868 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:15.807555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc80a0-2e86-4f7e-ab01-348bfc8f2868 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:15.807961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc80a0-2e86-4f7e-ab01-348bfc8f2868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:15.852750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-61bc80a0-2e86-4f7e-ab01-348bfc8f2868 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:15.855422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-61bc80a0-2e86-4f7e-ab01-348bfc8f2868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:15.889155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:15.900988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7b461-f098-47e9-aabe-b8631e87540a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:15.914603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:15.915266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:15.915547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:15.918161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:15.919802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:15.925243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:15.958454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 840/1669] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:15.962467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:15.980576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:15.990032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13734067-97a2-441e-b31d-22253707d3ed admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.004822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 830/1670] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:32:16.012046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc80a0-2e86-4f7e-ab01-348bfc8f2868 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:16.019231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afe41b-6277-452c-ba37-35d7b69a2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.023514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe41b-6277-452c-ba37-35d7b69a2774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.023807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe41b-6277-452c-ba37-35d7b69a2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.027557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe41b-6277-452c-ba37-35d7b69a2774 admin admin] PATH_INFO: `/v3/projects/c5936850bc9445079a3af504e21b23b7/users/6fdc9528fe8442cab760eb85fb92e2f4/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.031995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afe41b-6277-452c-ba37-35d7b69a2774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5936850bc9445079a3af504e21b23b7, user_id=6fdc9528fe8442cab760eb85fb92e2f4, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.032639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc80a0-2e86-4f7e-ab01-348bfc8f2868 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.039226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afe41b-6277-452c-ba37-35d7b69a2774 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.044893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.045973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.046890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.047254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.048116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:16.050684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.054799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.061438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 841/1671] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:15 2022] PUT /identity/v3/projects/c5936850bc9445079a3af504e21b23b7/users/6fdc9528fe8442cab760eb85fb92e2f4/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:16.072386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.072880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.073348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.084631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 831/1672] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:16.086460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:16.111883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99f40f-15f6-48da-97c6-7de60058d4f0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.133430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] MFA Rules not processed for user `6fdc9528fe8442cab760eb85fb92e2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:16.134684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:16.257009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.257701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.257990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.258274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.258965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.260923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.320814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 842/1673] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:16.344441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 832/1674] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:16 2022] POST /identity/v3/projects => generated 405 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:16.350098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:16.353861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:16.354086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:16.528031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676bb48-1252-42c9-87bb-8f8b0d000d0d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.547707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8065c5-72b8-4a37-84ce-f41c26273045 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.567578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.568251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.568547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.568826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.569559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.571587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.627277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 833/1675] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:16 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:16.631895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:16.660557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f64fef-3a9f-4225-8857-a822a91dee08 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.671683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.672341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.672993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.673314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.674036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.681663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.684382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.685048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.685353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.689417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.711379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 834/1676] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:16.718686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:16.738386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ac79-452b-49ee-be2f-e235322fa6f5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.748797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.749486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.750345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.750639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.751355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.753182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.779678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:16.789363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 835/1677] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:16.816487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:16.833334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:16.837033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5ea0-295c-4573-b863-43c5ee390ab6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:16.845366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9754-9b5a-45de-89b3-1ea5581441b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:16.846321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9754-9b5a-45de-89b3-1ea5581441b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.846802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9754-9b5a-45de-89b3-1ea5581441b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.847387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9754-9b5a-45de-89b3-1ea5581441b7 admin admin] PATH_INFO: `/v3/projects/5633a13ebc7d48e19cd0ab949162e4e0/users/2074f904194d420f869997f43180f86b/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.868784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9754-9b5a-45de-89b3-1ea5581441b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5633a13ebc7d48e19cd0ab949162e4e0, user_id=2074f904194d420f869997f43180f86b, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.874545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9754-9b5a-45de-89b3-1ea5581441b7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.875401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:16.877032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:16.906318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 836/1678] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:16 2022] PUT /identity/v3/projects/5633a13ebc7d48e19cd0ab949162e4e0/users/2074f904194d420f869997f43180f86b/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:16.912117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 843/1679] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:16.913519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94cb22-35bf-48f3-94c5-f0758e336ddd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:16.913987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94cb22-35bf-48f3-94c5-f0758e336ddd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:16.914612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94cb22-35bf-48f3-94c5-f0758e336ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:16.948049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2f94cb22-35bf-48f3-94c5-f0758e336ddd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:16.950408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2f94cb22-35bf-48f3-94c5-f0758e336ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:17.116031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 837/1680] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:17.164913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:17.166826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:17.336638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867420f-0f50-4917-832a-31aadb56b391 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:17.524027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10afaa-9431-47c1-8e48-9e4fcc83d15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:17.524705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10afaa-9431-47c1-8e48-9e4fcc83d15e service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:17.524991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10afaa-9431-47c1-8e48-9e4fcc83d15e service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:17.525269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10afaa-9431-47c1-8e48-9e4fcc83d15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:17.575111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10afaa-9431-47c1-8e48-9e4fcc83d15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:17.583329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10afaa-9431-47c1-8e48-9e4fcc83d15e service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:17.630610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 844/1681] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:17.961236 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94cb22-35bf-48f3-94c5-f0758e336ddd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:17.976139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94cb22-35bf-48f3-94c5-f0758e336ddd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:17.989184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:17.990311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:17.990802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:17.991303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] PATH_INFO: `/v3/users/5c4e02455e414537ab3e9b0539a505a5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:18.006034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4e02455e414537ab3e9b0539a505a5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:18.012337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:18.179776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4e02455e414537ab3e9b0539a505a5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:18.193126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4e02455e414537ab3e9b0539a505a5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:18.225913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4e02455e414537ab3e9b0539a505a5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:18.268948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4e02455e414537ab3e9b0539a505a5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:18.269588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4e02455e414537ab3e9b0539a505a5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:18.283129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 838/1682] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:17 2022] DELETE /identity/v3/users/5c4e02455e414537ab3e9b0539a505a5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:18.288426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:18.288815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:18.289164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:18.336403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:18.337785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:18.533777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 845/1683] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:18.559929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:18.561635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:18.698419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:18.711205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113acfb-9cc6-4abe-b141-0536656fbcd5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:18.724675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:18.727751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:18.728225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:18.730402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:18.753083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:18.756708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:18.784818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 839/1684] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:20.041015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:20.042553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:20.060656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cf90e-85af-41a6-b95b-9c8e436265a9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:20.079191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:20.080131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:20.080537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:20.081008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] PATH_INFO: `/v3/projects/36055274d1a64258a5338b00435d45ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:20.083485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36055274d1a64258a5338b00435d45ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:20.089414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:20.250567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:20.275836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36055274d1a64258a5338b00435d45ce', 'request_id': 'req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.296474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36055274d1a64258a5338b00435d45ce', 'request_id': 'req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.331367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36055274d1a64258a5338b00435d45ce', 'request_id': 'req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.350485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] The token cache is being invalidate because project 36055274d1a64258a5338b00435d45ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:20.352329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.354551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4531edea-57ea-4d6c-8c88-baf5d6e63f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.358202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 846/1685] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:20 2022] DELETE /identity/v3/projects/36055274d1a64258a5338b00435d45ce => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:20.362296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:20.377026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18009f2-8977-43d3-a3b9-7dbf1c3092fd service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:20.535301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:20.536469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:20.536907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:20.537356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] PATH_INFO: `/v3/users/6fdc9528fe8442cab760eb85fb92e2f4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:20.538935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdc9528fe8442cab760eb85fb92e2f4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:20.541434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:20.655486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdc9528fe8442cab760eb85fb92e2f4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.671183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdc9528fe8442cab760eb85fb92e2f4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.681841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdc9528fe8442cab760eb85fb92e2f4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.716736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdc9528fe8442cab760eb85fb92e2f4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.718119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdc9528fe8442cab760eb85fb92e2f4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:20.732027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64ca7-d56f-44c9-99e5-27a4ffc40e81 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:20.732410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64ca7-d56f-44c9-99e5-27a4ffc40e81 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:20.732589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 840/1686] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:20 2022] DELETE /identity/v3/users/6fdc9528fe8442cab760eb85fb92e2f4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:20.732822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64ca7-d56f-44c9-99e5-27a4ffc40e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:20.806020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-60a64ca7-d56f-44c9-99e5-27a4ffc40e81 None None] MFA Rules not processed for user `5b6e13a14dd64724aaff936a6c1e3d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:20.807490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-60a64ca7-d56f-44c9-99e5-27a4ffc40e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:20.976602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 847/1687] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:21.009488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:21.012736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:21.127430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9cd8b-b1b1-4e3d-a656-dec719b44931 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:21.127939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9cd8b-b1b1-4e3d-a656-dec719b44931 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:21.128086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9cd8b-b1b1-4e3d-a656-dec719b44931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:21.248828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b2b9cd8b-b1b1-4e3d-a656-dec719b44931 None None] MFA Rules not processed for user `b8310ac5940945e1bb32d91834459ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:21.255416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b2b9cd8b-b1b1-4e3d-a656-dec719b44931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:21.364287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e684f0a-9db8-4e68-9535-92256a52a4f3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:21.405027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6e9c4-964c-4c6c-921a-325905df84e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:21.405739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e9c4-964c-4c6c-921a-325905df84e6 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:21.406025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e9c4-964c-4c6c-921a-325905df84e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:21.406786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e9c4-964c-4c6c-921a-325905df84e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:21.430864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:21.438304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6e9c4-964c-4c6c-921a-325905df84e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:21.449847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6e9c4-964c-4c6c-921a-325905df84e6 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:21.483345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 841/1688] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:21.550669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 848/1689] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:21.561400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727cb3-ecf9-4ab2-94e8-0da5759ae692 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:21.561784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727cb3-ecf9-4ab2-94e8-0da5759ae692 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:21.561959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727cb3-ecf9-4ab2-94e8-0da5759ae692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:21.610082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d7727cb3-ecf9-4ab2-94e8-0da5759ae692 None None] MFA Rules not processed for user `b8310ac5940945e1bb32d91834459ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:21.616570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d7727cb3-ecf9-4ab2-94e8-0da5759ae692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:21.637503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 842/1690] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:21.877054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:21.877844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:21.878273 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:21.894217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727cb3-ecf9-4ab2-94e8-0da5759ae692 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:21.913118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727cb3-ecf9-4ab2-94e8-0da5759ae692 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:21.935415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:21.936176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:21.936460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:21.939285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:21.959778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:21.960926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:21.965469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] MFA Rules not processed for user `35725724ab3d4148858c7f9cded65484`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:21.968322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:21.999777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 843/1691] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:22.001034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:22.008769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.117586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:22.187289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 849/1692] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:22.188884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:22.190797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.263733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1bcd-3436-48b5-afde-40da25251913 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:22.271340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:22.272690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.273145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.274218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] PATH_INFO: `/v3/projects/c5936850bc9445079a3af504e21b23b7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.276532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5936850bc9445079a3af504e21b23b7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:22.279630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:22.345343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9a2de-e3a4-4ec1-ab2e-01be9e7483c0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:22.367852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5936850bc9445079a3af504e21b23b7', 'request_id': 'req-1387c7d3-98e0-4f41-8439-a8a971029bfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.382414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5936850bc9445079a3af504e21b23b7', 'request_id': 'req-1387c7d3-98e0-4f41-8439-a8a971029bfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.391510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5936850bc9445079a3af504e21b23b7', 'request_id': 'req-1387c7d3-98e0-4f41-8439-a8a971029bfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.405326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] The token cache is being invalidate because project c5936850bc9445079a3af504e21b23b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:22.406059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.406936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1387c7d3-98e0-4f41-8439-a8a971029bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.410090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 844/1693] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:21 2022] DELETE /identity/v3/projects/c5936850bc9445079a3af504e21b23b7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:22.411870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2689a-a892-42b9-a906-e4206678d3de None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.412325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2689a-a892-42b9-a906-e4206678d3de None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.412736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2689a-a892-42b9-a906-e4206678d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.437938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-22a2689a-a892-42b9-a906-e4206678d3de None None] MFA Rules not processed for user `35725724ab3d4148858c7f9cded65484`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:22.439666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-22a2689a-a892-42b9-a906-e4206678d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.447386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:22.448555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.450597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.451215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] PATH_INFO: `/v3/users/aa2ec2d66eba4da1895adbe39a7b2b76` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.454682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2ec2d66eba4da1895adbe39a7b2b76)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:22.457131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:32:22.457131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Jul 29 08:32:22.457131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: Jul 29 08:32:22.460164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:22.522366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 845/1694] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:22.535750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.536449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.536873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.568767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:22.582069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] MFA Rules not processed for user `2074f904194d420f869997f43180f86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:22.584828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2ec2d66eba4da1895adbe39a7b2b76'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.585603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.596756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2ec2d66eba4da1895adbe39a7b2b76'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.621229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2ec2d66eba4da1895adbe39a7b2b76'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.643025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2ec2d66eba4da1895adbe39a7b2b76'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.645399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c78c70c8-1d97-4528-ace2-573930cbc077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2ec2d66eba4da1895adbe39a7b2b76'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:22.649576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:22.660462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 850/1695] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:22 2022] DELETE /identity/v3/users/aa2ec2d66eba4da1895adbe39a7b2b76 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:22.666473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c961-ec8e-477f-980d-5f71358e5c22 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.666592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c961-ec8e-477f-980d-5f71358e5c22 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.666821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c961-ec8e-477f-980d-5f71358e5c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.697824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0c82c961-ec8e-477f-980d-5f71358e5c22 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:22.701577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0c82c961-ec8e-477f-980d-5f71358e5c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.709089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 846/1696] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:22.710422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:22.715562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.807659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 851/1697] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:22.810403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.810790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.811074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.838057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:22.841539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.850060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff037dcd-0787-42c8-893c-87141da435d9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:22.861332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 852/1698] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:22.862212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:22.864899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.882551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29094fe3-16bf-4ff3-883b-7c5642fbe0f3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:22.888943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fac47a-3711-4fac-9c11-947c1c414382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:22.890188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fac47a-3711-4fac-9c11-947c1c414382 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.890938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fac47a-3711-4fac-9c11-947c1c414382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.891408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fac47a-3711-4fac-9c11-947c1c414382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.892269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fac47a-3711-4fac-9c11-947c1c414382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:22.895105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fac47a-3711-4fac-9c11-947c1c414382 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:22.959753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:22.960329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:22.960748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:22.960915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:22.963995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:22.999916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 853/1699] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:22 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:23.001542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f217aa-5389-45dd-8985-96d36bae60ef None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.001949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f217aa-5389-45dd-8985-96d36bae60ef None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.006787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f217aa-5389-45dd-8985-96d36bae60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.010181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:23.055662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.057670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.064110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-58f217aa-5389-45dd-8985-96d36bae60ef None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:23.069862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-58f217aa-5389-45dd-8985-96d36bae60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:23.071096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 847/1700] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:23.072434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.074888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:23.217711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebb72-4642-4712-a7a9-7886aed41c30 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.251562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 854/1701] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:23.253049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a66080-6e23-4a8b-b10a-9338da610204 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.253378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a66080-6e23-4a8b-b10a-9338da610204 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.253903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a66080-6e23-4a8b-b10a-9338da610204 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.257518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 855/1702] 10.222.0.47 () {54 vars in 912 bytes} [Fri Jul 29 08:32:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:23.259371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a66080-6e23-4a8b-b10a-9338da610204 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.302321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a66080-6e23-4a8b-b10a-9338da610204 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.314063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.315077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.315493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.315931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.322609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648a1a0-5963-4061-8514-d62d321d46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.323320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648a1a0-5963-4061-8514-d62d321d46b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.323607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648a1a0-5963-4061-8514-d62d321d46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.323884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648a1a0-5963-4061-8514-d62d321d46b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.324658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648a1a0-5963-4061-8514-d62d321d46b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.327452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648a1a0-5963-4061-8514-d62d321d46b5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.329306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.331118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.345406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 848/1703] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:23.346541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.360838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4cd75-2207-4059-90a8-ee7d4daf13b5 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.369212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.370333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.370510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.370863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.371824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:23.372986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.377250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.395106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 856/1704] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:23 2022] POST /identity/v3/users => generated 309 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:23.396439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae16010-5f6e-4ef2-9c50-9ce20f09fd68 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.396736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae16010-5f6e-4ef2-9c50-9ce20f09fd68 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.397015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae16010-5f6e-4ef2-9c50-9ce20f09fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.410612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 849/1705] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:23.414314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.427022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd5900-1d05-4898-b6fc-110bd509283f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.434985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.436058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.436472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.436911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.437786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.441125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.456384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 850/1706] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:23.457885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.479629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f128b1-9c48-4fc9-adbd-74f8a74c86cc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.488465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.489462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.489999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.490764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.491678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.493861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.533333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fae16010-5f6e-4ef2-9c50-9ce20f09fd68 None None] MFA Rules not processed for user `2929dcc2eee6498393466499b61d6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:23.534990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fae16010-5f6e-4ef2-9c50-9ce20f09fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:23.553640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 851/1707] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:23 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:23.553640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.554135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 857/1708] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:32:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:23.555305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae16010-5f6e-4ef2-9c50-9ce20f09fd68 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.574574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae16010-5f6e-4ef2-9c50-9ce20f09fd68 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.653475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:23.712995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.713789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.714075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.714351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.715482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.717985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.725696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:23.748172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc19cb-15b5-422f-9d89-fa029422467d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.755680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.760924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.767695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 858/1709] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:23 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:23.767862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.767862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] PATH_INFO: `/v3/projects/81264b8ae9ee46efb6ebf113d9bd0d61/users/a4c2b5ec88234b4cb60ef846c16f9e23/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.769726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.791229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d742ea-664f-427d-ab20-52516b0b41a9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.801742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.802390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.802817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.802953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.804423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.806084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81264b8ae9ee46efb6ebf113d9bd0d61, user_id=a4c2b5ec88234b4cb60ef846c16f9e23, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.808763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.811434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:23.826622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 859/1710] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:23.827535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.837307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 852/1711] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:23 2022] PUT /identity/v3/projects/81264b8ae9ee46efb6ebf113d9bd0d61/users/a4c2b5ec88234b4cb60ef846c16f9e23/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:23.839350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:23.979395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b24f1-aa0d-4dc4-9ffe-1cc4f86771c0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:23.984426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:23.985069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:23.985397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:23.985679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:23.986386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:23.988045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:24.001204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 853/1712] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:24.002850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:24.005490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3339-a67c-4126-a4a9-ce05842c6675 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:24.017804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416977b6-4e59-4b0e-9088-e4de7314b902 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:24.022943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5dd9-4776-44ba-93f1-9d60cabea69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:24.023497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5dd9-4776-44ba-93f1-9d60cabea69f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.023782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5dd9-4776-44ba-93f1-9d60cabea69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.024059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5dd9-4776-44ba-93f1-9d60cabea69f admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.024763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5dd9-4776-44ba-93f1-9d60cabea69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:24.026438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5dd9-4776-44ba-93f1-9d60cabea69f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:24.037801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 854/1713] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:24.039204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924cfe-2787-4cf6-98fe-2145bd4672e7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.039498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924cfe-2787-4cf6-98fe-2145bd4672e7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.039777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924cfe-2787-4cf6-98fe-2145bd4672e7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.041658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 855/1714] 10.222.0.47 () {54 vars in 912 bytes} [Fri Jul 29 08:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:24.042360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924cfe-2787-4cf6-98fe-2145bd4672e7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:24.055623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924cfe-2787-4cf6-98fe-2145bd4672e7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:24.066839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:24.067923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.069161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.069690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] PATH_INFO: `/v3/projects/ad0dbce21ff044e988a87ffc5488dafc/users/112df7ef87a14404ad0ee32282569b4b/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.104190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0dbce21ff044e988a87ffc5488dafc, user_id=112df7ef87a14404ad0ee32282569b4b, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:24.109814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:24.125019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b449b0-ac57-4bc9-a6d8-9e2264d3e1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:24.127184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b449b0-ac57-4bc9-a6d8-9e2264d3e1fd service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.128101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b449b0-ac57-4bc9-a6d8-9e2264d3e1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.128777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b449b0-ac57-4bc9-a6d8-9e2264d3e1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.151934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 856/1715] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:24 2022] PUT /identity/v3/projects/ad0dbce21ff044e988a87ffc5488dafc/users/112df7ef87a14404ad0ee32282569b4b/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:24.155746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:24.169181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b449b0-ac57-4bc9-a6d8-9e2264d3e1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:24.180516 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b449b0-ac57-4bc9-a6d8-9e2264d3e1fd service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:24.215223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 860/1716] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:24.219741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.220155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.221941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.300821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] MFA Rules not processed for user `2929dcc2eee6498393466499b61d6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:24.303766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:24.366028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354877-d402-441e-b83d-f30ebaca937d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:24.379838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518439b-bccd-4971-b44f-443210b4fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:24.382061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518439b-bccd-4971-b44f-443210b4fcd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.382517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518439b-bccd-4971-b44f-443210b4fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.382967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518439b-bccd-4971-b44f-443210b4fcd7 admin admin] PATH_INFO: `/v3/projects/81264b8ae9ee46efb6ebf113d9bd0d61/users/a4c2b5ec88234b4cb60ef846c16f9e23/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.387378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518439b-bccd-4971-b44f-443210b4fcd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81264b8ae9ee46efb6ebf113d9bd0d61, user_id=a4c2b5ec88234b4cb60ef846c16f9e23, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:24.392133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518439b-bccd-4971-b44f-443210b4fcd7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:24.437887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 857/1717] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:24 2022] PUT /identity/v3/projects/81264b8ae9ee46efb6ebf113d9bd0d61/users/a4c2b5ec88234b4cb60ef846c16f9e23/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:24.437887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.437887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.438189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.450119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 861/1718] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:32:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:24.451976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:24.459894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:24.499839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9dde-1940-4543-b2cf-930438a576d7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:24.530415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] MFA Rules not processed for user `112df7ef87a14404ad0ee32282569b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:24.532142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:24.561264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:24.575504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:24.696040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:24.697356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:24.697642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:24.697920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] PATH_INFO: `/v3/projects/92130ff938dc47098c93cbb3c2a2aa78` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:24.702392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92130ff938dc47098c93cbb3c2a2aa78)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:24.704939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:24.753574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 858/1719] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:24.754214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:24.761634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:24.882326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92130ff938dc47098c93cbb3c2a2aa78', 'request_id': 'req-21c82ee9-9701-499d-a780-60b2fc1ec0c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:24.902421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92130ff938dc47098c93cbb3c2a2aa78', 'request_id': 'req-21c82ee9-9701-499d-a780-60b2fc1ec0c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:24.939195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92130ff938dc47098c93cbb3c2a2aa78', 'request_id': 'req-21c82ee9-9701-499d-a780-60b2fc1ec0c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:24.966841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] The token cache is being invalidate because project 92130ff938dc47098c93cbb3c2a2aa78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:24.967142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:24.975709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:24.977119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4da8-24f9-4f34-8355-4282f9a9a14f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:24.978792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 862/1720] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:24 2022] DELETE /identity/v3/projects/92130ff938dc47098c93cbb3c2a2aa78 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:24.979567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:24.984253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:25.157019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95d47-8fd8-4fe8-a240-3a68dd251044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:25.158311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95d47-8fd8-4fe8-a240-3a68dd251044 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.159158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95d47-8fd8-4fe8-a240-3a68dd251044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.159800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95d47-8fd8-4fe8-a240-3a68dd251044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.166137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1ad95d47-8fd8-4fe8-a240-3a68dd251044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:25.216211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82ee9-9701-499d-a780-60b2fc1ec0c6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:25.217769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95d47-8fd8-4fe8-a240-3a68dd251044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:25.220826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95d47-8fd8-4fe8-a240-3a68dd251044 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:25.242250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:25.243396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.243396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.243583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.244153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:25.247620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:25.261610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 859/1721] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:25.263762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aeb2f-5d8b-460a-903c-03c1e595aabd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.270140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aeb2f-5d8b-460a-903c-03c1e595aabd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.272568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aeb2f-5d8b-460a-903c-03c1e595aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.347392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6d9aeb2f-5d8b-460a-903c-03c1e595aabd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:25.349115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6d9aeb2f-5d8b-460a-903c-03c1e595aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:25.359218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 863/1722] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:24 2022] POST /identity/v3/projects => generated 381 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:25.362276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:25.506150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:25.593538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 860/1723] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:25.607874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5be2-339c-4bb5-a9cc-04b4cb7f58db None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.608646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe66b-59dd-4693-9208-f6019a8c3a47 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:25.608920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5be2-339c-4bb5-a9cc-04b4cb7f58db None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.609848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5be2-339c-4bb5-a9cc-04b4cb7f58db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.633263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907c303-ed41-482b-915c-228d10fa627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:25.646324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907c303-ed41-482b-915c-228d10fa627d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.646455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907c303-ed41-482b-915c-228d10fa627d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.649919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907c303-ed41-482b-915c-228d10fa627d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.653596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907c303-ed41-482b-915c-228d10fa627d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:25.668275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907c303-ed41-482b-915c-228d10fa627d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:25.680647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-183a5be2-339c-4bb5-a9cc-04b4cb7f58db None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:25.681936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-183a5be2-339c-4bb5-a9cc-04b4cb7f58db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:25.694629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 861/1724] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:25.694629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb5d06-f7e3-41b2-9aa8-ab87db3aa5d5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.694629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb5d06-f7e3-41b2-9aa8-ab87db3aa5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.694629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb5d06-f7e3-41b2-9aa8-ab87db3aa5d5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.695489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 862/1725] 10.222.0.47 () {54 vars in 961 bytes} [Fri Jul 29 08:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:25.696245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb5d06-f7e3-41b2-9aa8-ab87db3aa5d5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:25.727790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 864/1726] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:25 2022] POST /identity/v3/users => generated 297 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:25.727790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a1c4-b695-48e6-b6d8-f98dfacd9009 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.727790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a1c4-b695-48e6-b6d8-f98dfacd9009 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.727790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a1c4-b695-48e6-b6d8-f98dfacd9009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.732606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb5d06-f7e3-41b2-9aa8-ab87db3aa5d5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:25.742914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:25.743711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.744066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.744331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.745044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:25.745386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:25.747029 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:25.757078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:25.767979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2e02a1c4-b695-48e6-b6d8-f98dfacd9009 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:25.769324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2e02a1c4-b695-48e6-b6d8-f98dfacd9009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:25.777778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 863/1727] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:25.777778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:25.817325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36376-bd03-4299-8535-01be177459a5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:25.848241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:25.852726 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.854773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.855321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.860431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:25.873540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:25.928659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 865/1728] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Jul 29 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:25.930907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48044ba0-794b-4d8d-be0e-088a2b5b0859 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:25.931271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48044ba0-794b-4d8d-be0e-088a2b5b0859 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:25.931623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48044ba0-794b-4d8d-be0e-088a2b5b0859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:25.943565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 864/1729] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:25.952746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:25.960990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-48044ba0-794b-4d8d-be0e-088a2b5b0859 None None] MFA Rules not processed for user `5b6e13a14dd64724aaff936a6c1e3d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:25.962635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-48044ba0-794b-4d8d-be0e-088a2b5b0859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:25.992546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eef24-d68d-412a-8d73-ef8614ac3efa admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.009838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.029646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.029646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.029646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.029646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.029646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:26.056393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 866/1730] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:26.058718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48044ba0-794b-4d8d-be0e-088a2b5b0859 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:26.098023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 865/1731] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:25 2022] POST /identity/v3/projects => generated 357 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:26.099965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:26.119787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48044ba0-794b-4d8d-be0e-088a2b5b0859 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.298206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9bbf0-98e6-4ef8-ae01-0a844d59b845 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.299089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9bbf0-98e6-4ef8-ae01-0a844d59b845 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.300033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9bbf0-98e6-4ef8-ae01-0a844d59b845 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.300485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9bbf0-98e6-4ef8-ae01-0a844d59b845 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.303916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-90d9bbf0-98e6-4ef8-ae01-0a844d59b845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:26.339003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9bbf0-98e6-4ef8-ae01-0a844d59b845 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.341721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9bbf0-98e6-4ef8-ae01-0a844d59b845 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:26.357891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:26.370317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 867/1732] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:26.372267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282c84-7f86-44bb-b4f3-7f12c9d00b66 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.372409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282c84-7f86-44bb-b4f3-7f12c9d00b66 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.372679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282c84-7f86-44bb-b4f3-7f12c9d00b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.397516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0049e-b60f-425a-8a95-cd004a946ed6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.418747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.419454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.419737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.420014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] PATH_INFO: `/v3/projects/31e984726ee14708ad85ee2b3bc8c751/users/aca0fcd8078749338cb59b82ab8b0baa/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.428523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2b282c84-7f86-44bb-b4f3-7f12c9d00b66 None None] MFA Rules not processed for user `b8310ac5940945e1bb32d91834459ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:26.437140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2b282c84-7f86-44bb-b4f3-7f12c9d00b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:26.469736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e984726ee14708ad85ee2b3bc8c751, user_id=aca0fcd8078749338cb59b82ab8b0baa, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.472990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:26.515918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 866/1733] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:26 2022] PUT /identity/v3/projects/31e984726ee14708ad85ee2b3bc8c751/users/aca0fcd8078749338cb59b82ab8b0baa/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:26.515918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:26.581430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 868/1734] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:26.582845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282c84-7f86-44bb-b4f3-7f12c9d00b66 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:26.651110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282c84-7f86-44bb-b4f3-7f12c9d00b66 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.740543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba7f06-ab82-4e7c-a33b-3f6d064c5da4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.768559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.769262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.769568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.769844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.770530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.772506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:26.820372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 867/1735] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:26 2022] POST /identity/v3/users => generated 279 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:26.825234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:26.858822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135021d-2aef-41ae-a363-59986f79505b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.861316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.861593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.861928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.862252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.867119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.868434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:26.880192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.880855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.881141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.881446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.882173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.883819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:26.914480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 869/1736] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:26.920806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:26.930403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 868/1737] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:26.935759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:26.946426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fea4-b242-40f8-85eb-a3a127c80b2f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.962247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64ab97-ac7a-4b69-982a-d000dddb04f2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:26.964363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a3988-f9cb-4ed1-a130-df723a8bd1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.965085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3988-f9cb-4ed1-a130-df723a8bd1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.965404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3988-f9cb-4ed1-a130-df723a8bd1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.965769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3988-f9cb-4ed1-a130-df723a8bd1b9 admin admin] PATH_INFO: `/v3/projects/31e984726ee14708ad85ee2b3bc8c751/users/aca0fcd8078749338cb59b82ab8b0baa/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.970582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a3988-f9cb-4ed1-a130-df723a8bd1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e984726ee14708ad85ee2b3bc8c751, user_id=aca0fcd8078749338cb59b82ab8b0baa, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.973611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a3988-f9cb-4ed1-a130-df723a8bd1b9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:26.975343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:26.976737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:26.977759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:26.978765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:26.980678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:26.983910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:27.006563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 870/1738] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:26 2022] PUT /identity/v3/projects/31e984726ee14708ad85ee2b3bc8c751/users/aca0fcd8078749338cb59b82ab8b0baa/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:27.024405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:27.025113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:27.025590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:27.073431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 869/1739] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:27.075064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:27.092945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] MFA Rules not processed for user `aca0fcd8078749338cb59b82ab8b0baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:27.096184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:27.103269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f20c-3a28-4d95-b47b-7617273eed7f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:27.135794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:27.299079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 871/1740] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:27.316020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:27.349244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:27.379752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736eb93-9dcb-4485-abd6-1fb321296b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:27.380702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736eb93-9dcb-4485-abd6-1fb321296b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:27.381813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736eb93-9dcb-4485-abd6-1fb321296b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:27.382237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736eb93-9dcb-4485-abd6-1fb321296b04 admin admin] PATH_INFO: `/v3/projects/ee1bfa578fec4f569c2662588b1df15c/users/3168c01f27fb49c9a8f62993e3d681e5/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:27.397902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:27.459729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736eb93-9dcb-4485-abd6-1fb321296b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1bfa578fec4f569c2662588b1df15c, user_id=3168c01f27fb49c9a8f62993e3d681e5, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:27.469102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736eb93-9dcb-4485-abd6-1fb321296b04 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:27.521480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 870/1741] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:27 2022] PUT /identity/v3/projects/ee1bfa578fec4f569c2662588b1df15c/users/3168c01f27fb49c9a8f62993e3d681e5/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:27.536445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b257a-a8f7-4223-bffd-53460ad10479 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:27.536956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b257a-a8f7-4223-bffd-53460ad10479 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:27.537381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b257a-a8f7-4223-bffd-53460ad10479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:27.658497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-187b257a-a8f7-4223-bffd-53460ad10479 None None] MFA Rules not processed for user `3168c01f27fb49c9a8f62993e3d681e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:27.665349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-187b257a-a8f7-4223-bffd-53460ad10479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:27.710257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370a27f-d0cf-45b3-8dcf-01bb5136874c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:27.908591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 871/1742] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:27 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:27.913173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b257a-a8f7-4223-bffd-53460ad10479 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:28.125954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b257a-a8f7-4223-bffd-53460ad10479 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:28.150417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:28.152201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:28.152516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:28.152794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:28.157916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:28.160263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96f3f-8c24-4e4c-9ace-999e9852b305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:28.161356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96f3f-8c24-4e4c-9ace-999e9852b305 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:28.161737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96f3f-8c24-4e4c-9ace-999e9852b305 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:28.162125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96f3f-8c24-4e4c-9ace-999e9852b305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:28.164775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:28.269050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 872/1743] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:27 2022] POST /identity/v3/projects => generated 355 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:28.273919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:28.322827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:28.434757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b96f3f-8c24-4e4c-9ace-999e9852b305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:28.437878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b96f3f-8c24-4e4c-9ace-999e9852b305 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:28.473501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 872/1744] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 1158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:28.542625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e59cef-dedd-46e6-90eb-f078f567628d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:28.543144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e59cef-dedd-46e6-90eb-f078f567628d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:28.543511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e59cef-dedd-46e6-90eb-f078f567628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:28.546062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db45bc-3105-4b5e-8a5c-e80d538aa680 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:28.562177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:28.569402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:28.570450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:28.573682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:28.576199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:28.584258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:28.659025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d0e59cef-dedd-46e6-90eb-f078f567628d None None] MFA Rules not processed for user `a4c2b5ec88234b4cb60ef846c16f9e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:28.660309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d0e59cef-dedd-46e6-90eb-f078f567628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:28.715548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 873/1745] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:28 2022] POST /identity/v3/users => generated 284 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:28.721751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:28.775565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164d384-60f8-4132-8e77-48912a8b0d0b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:28.806047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:28.806709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:28.806995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:28.807279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:28.808973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:28.813803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:28.864067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 874/1746] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:28.867801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:28.920374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f67fa-ee77-4195-bb9f-e3f0b9744db0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:28.941834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:28.942576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:28.944482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:28.944656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] PATH_INFO: `/v3/projects/a804d7ad5f6349d78296427674ba2b5e/users/d02dafa825ee4d51a726423a5f1af62c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:28.952118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 873/1747] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:28 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:28.953172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e59cef-dedd-46e6-90eb-f078f567628d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:28.968186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:29.023205 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a804d7ad5f6349d78296427674ba2b5e, user_id=d02dafa825ee4d51a726423a5f1af62c, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:29.032497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:29.102839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 875/1748] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:28 2022] PUT /identity/v3/projects/a804d7ad5f6349d78296427674ba2b5e/users/d02dafa825ee4d51a726423a5f1af62c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:29.108968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:29.198089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e59cef-dedd-46e6-90eb-f078f567628d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:29.424471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:29.425107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:29.425424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:29.425708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:29.431090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:29.435094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b36d-e5b1-472e-ab4b-f90857fccf9e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:29.442544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:29.443845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:29.444359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:29.445618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:29.446889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:29.450875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:29.497271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 876/1749] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:29.502057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:29.534317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfcdc9-6186-46e5-96f6-3c0aad7e4c9d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:29.566038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755fbca-b587-48c3-bf4e-b783fed64224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:29.567191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fbca-b587-48c3-bf4e-b783fed64224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:29.568590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fbca-b587-48c3-bf4e-b783fed64224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:29.569694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fbca-b587-48c3-bf4e-b783fed64224 admin admin] PATH_INFO: `/v3/projects/a804d7ad5f6349d78296427674ba2b5e/users/d02dafa825ee4d51a726423a5f1af62c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:29.576108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755fbca-b587-48c3-bf4e-b783fed64224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a804d7ad5f6349d78296427674ba2b5e, user_id=d02dafa825ee4d51a726423a5f1af62c, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:29.586289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755fbca-b587-48c3-bf4e-b783fed64224 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:29.636215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 877/1750] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:29 2022] PUT /identity/v3/projects/a804d7ad5f6349d78296427674ba2b5e/users/d02dafa825ee4d51a726423a5f1af62c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:29.649702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87ef0-d0f4-4b13-b4a3-cc8ed12a5f6e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:29.650110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87ef0-d0f4-4b13-b4a3-cc8ed12a5f6e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:29.651073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:29.651549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87ef0-d0f4-4b13-b4a3-cc8ed12a5f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:29.652765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:29.695832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 874/1751] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:29.718734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9bc87ef0-d0f4-4b13-b4a3-cc8ed12a5f6e None None] MFA Rules not processed for user `d02dafa825ee4d51a726423a5f1af62c`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:29.721397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9bc87ef0-d0f4-4b13-b4a3-cc8ed12a5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:29.839558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:29.974234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 878/1752] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:30.007761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:30.012481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:30.067252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde42c-4754-4001-a836-9e215b11bbd8 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:30.205168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd2ff-17ba-4f0f-ac80-1b7259288fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:30.206100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd2ff-17ba-4f0f-ac80-1b7259288fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:30.208051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd2ff-17ba-4f0f-ac80-1b7259288fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:30.208488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd2ff-17ba-4f0f-ac80-1b7259288fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:30.227869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd2ff-17ba-4f0f-ac80-1b7259288fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:30.229365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd2ff-17ba-4f0f-ac80-1b7259288fc2 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:30.264745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 875/1753] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:30 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:30.650039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc87ef0-d0f4-4b13-b4a3-cc8ed12a5f6e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:30.663537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc87ef0-d0f4-4b13-b4a3-cc8ed12a5f6e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:30.671176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b43ec-3398-44a1-8201-4681af9943cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:30.672124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b43ec-3398-44a1-8201-4681af9943cb service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:30.672579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b43ec-3398-44a1-8201-4681af9943cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:30.673023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b43ec-3398-44a1-8201-4681af9943cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:30.906085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b43ec-3398-44a1-8201-4681af9943cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:30.907778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b43ec-3398-44a1-8201-4681af9943cb service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:30.920453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 879/1754] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:30 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:31.086767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f7e0-414e-48e4-93a2-cdf446eaf956 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:31.087306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f7e0-414e-48e4-93a2-cdf446eaf956 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:31.087306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f7e0-414e-48e4-93a2-cdf446eaf956 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:31.088877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 876/1755] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:32:31.159154 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7ec6-e00e-4a89-934c-1b3c99c41ac3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:31.159619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7ec6-e00e-4a89-934c-1b3c99c41ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:31.160004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7ec6-e00e-4a89-934c-1b3c99c41ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:31.241006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-435a7ec6-e00e-4a89-934c-1b3c99c41ac3 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:31.242483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-435a7ec6-e00e-4a89-934c-1b3c99c41ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:31.516762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 880/1756] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:32:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:32:31.556754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f7e0-414e-48e4-93a2-cdf446eaf956 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:31.581271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f7e0-414e-48e4-93a2-cdf446eaf956 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:31.591286 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:31.592556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:31.592933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:31.593570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:31.640789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:31.664437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:31.688105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 877/1757] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:31.963142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d084dd-f03a-4b74-a768-a07e2da2778b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:31.963613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d084dd-f03a-4b74-a768-a07e2da2778b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:31.964178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d084dd-f03a-4b74-a768-a07e2da2778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:32.136505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-70d084dd-f03a-4b74-a768-a07e2da2778b None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:32.139199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-70d084dd-f03a-4b74-a768-a07e2da2778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:32.283405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:32.405083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 881/1758] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:32:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:32.653466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:32.655427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:32.662868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:32.841589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d25f6-89fc-4cd8-9bab-f9eddc69edc2 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:32.850435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f2187-01f1-4d05-8318-217e283a5418 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:32.851312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2187-01f1-4d05-8318-217e283a5418 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:32.851824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2187-01f1-4d05-8318-217e283a5418 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:32.852431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2187-01f1-4d05-8318-217e283a5418 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:32.869020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2187-01f1-4d05-8318-217e283a5418 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:32.872160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2187-01f1-4d05-8318-217e283a5418 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:32.887037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 878/1759] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:32:33.469930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d084dd-f03a-4b74-a768-a07e2da2778b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:33.665909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d084dd-f03a-4b74-a768-a07e2da2778b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:33.694593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:33.697351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:33.697724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:33.698496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] PATH_INFO: `/v3/users/112df7ef87a14404ad0ee32282569b4b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:33.700194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=112df7ef87a14404ad0ee32282569b4b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:33.704617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:33.936318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112df7ef87a14404ad0ee32282569b4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:33.969661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112df7ef87a14404ad0ee32282569b4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:33.988758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112df7ef87a14404ad0ee32282569b4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:34.018899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112df7ef87a14404ad0ee32282569b4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:34.019683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112df7ef87a14404ad0ee32282569b4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:34.027914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 882/1760] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:33 2022] DELETE /identity/v3/users/112df7ef87a14404ad0ee32282569b4b => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:34.033330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631aec4-b0e1-4b5f-b3f0-ba6a42d21c97 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:34.033934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631aec4-b0e1-4b5f-b3f0-ba6a42d21c97 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:34.034211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631aec4-b0e1-4b5f-b3f0-ba6a42d21c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:34.099408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5631aec4-b0e1-4b5f-b3f0-ba6a42d21c97 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:34.101813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5631aec4-b0e1-4b5f-b3f0-ba6a42d21c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:34.395588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 879/1761] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:34.514542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:34.516900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:34.700295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a643-a5a2-460b-a23b-b6183715bdd7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:34.723550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6bdae-16e5-4a86-b5ce-53db6519c90c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:34.724414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bdae-16e5-4a86-b5ce-53db6519c90c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:34.727174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bdae-16e5-4a86-b5ce-53db6519c90c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:34.728440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bdae-16e5-4a86-b5ce-53db6519c90c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:34.780012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6bdae-16e5-4a86-b5ce-53db6519c90c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:34.780012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6bdae-16e5-4a86-b5ce-53db6519c90c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:34.829032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 883/1762] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:35.995571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:35.996725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:35.997756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:36.076668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] MFA Rules not processed for user `2929dcc2eee6498393466499b61d6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:36.078831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:36.113437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 880/1763] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Jul 29 08:32:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:36.206814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4391ef-f9ef-4a8f-8536-389cec4a6217 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:36.208546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4391ef-f9ef-4a8f-8536-389cec4a6217 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:36.208968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4391ef-f9ef-4a8f-8536-389cec4a6217 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:36.210605 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 884/1764] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:36.226151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:36.228159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:36.252795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:36.253891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:36.254402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:36.259865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a05a-88c9-4c01-a888-f8b7e1539dbb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:36.272668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:36.274222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:36.275301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:36.276347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:36.277419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:36.311833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:36.314275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:36.327397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] MFA Rules not processed for user `8535cea602d743dfa892160338ebfd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:36.333041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:36.350678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 881/1765] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:36.354771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:36.357797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:36.405785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8c728-f83b-4d39-aa22-00fb9a1e087d service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:36.427300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:36.428246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:36.431950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:36.432498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] PATH_INFO: `/v3/users/0cdd089cc14c4198ab0c3c2cc7f996bf` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:36.437624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdd089cc14c4198ab0c3c2cc7f996bf)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:36.442991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:36.601425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 885/1766] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:32:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:32:36.604283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:36.609773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:36.622758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdd089cc14c4198ab0c3c2cc7f996bf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:36.626364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:36.672461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdd089cc14c4198ab0c3c2cc7f996bf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:36.681518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266277a0-fc28-439e-9c64-bdc240070f04 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:36.700218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdd089cc14c4198ab0c3c2cc7f996bf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:36.702046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:36.702982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:36.704250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:36.718093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] PATH_INFO: `/v3/users/2074f904194d420f869997f43180f86b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:36.723117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2074f904194d420f869997f43180f86b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:36.726840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdd089cc14c4198ab0c3c2cc7f996bf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:36.728486 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:36.732422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdd089cc14c4198ab0c3c2cc7f996bf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:36.756999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 882/1767] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:36 2022] DELETE /identity/v3/users/0cdd089cc14c4198ab0c3c2cc7f996bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:36.775222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:36.781598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:36.970562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2074f904194d420f869997f43180f86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:37.002731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2074f904194d420f869997f43180f86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:37.038009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2074f904194d420f869997f43180f86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:37.047359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d27da-9cc5-4cd4-a976-d7235f4b20ed admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:37.066269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:37.066944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:37.067234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:37.067521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:37.074250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:37.091127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2074f904194d420f869997f43180f86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:37.091127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02232779-64c7-4412-be01-ea3667173ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2074f904194d420f869997f43180f86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:37.123890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 886/1768] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:36 2022] DELETE /identity/v3/users/2074f904194d420f869997f43180f86b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:37.124427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:37.129582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:37.131525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:37.132034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:37.132496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:37.171065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 883/1769] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:37.216018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:37.224048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:37.501322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 887/1770] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:37.572850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:37.574504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:37.726770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cda48f-f4dd-4080-a42c-81849040f355 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:37.828638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:37.829324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:37.829623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:37.830070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:37.846414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:37.848109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:37.860151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 884/1771] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:39.070889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:39.073561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:39.101440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c2c07-cc6b-4ec2-995a-4677b7d439a7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:39.139132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:39.147451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:39.151534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:39.154075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] PATH_INFO: `/v3/projects/5633a13ebc7d48e19cd0ab949162e4e0` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:39.158091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5633a13ebc7d48e19cd0ab949162e4e0)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:39.165990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:39.187650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:39.319515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5633a13ebc7d48e19cd0ab949162e4e0', 'request_id': 'req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.336167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5633a13ebc7d48e19cd0ab949162e4e0', 'request_id': 'req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.349507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5633a13ebc7d48e19cd0ab949162e4e0', 'request_id': 'req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.374816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] The token cache is being invalidate because project 5633a13ebc7d48e19cd0ab949162e4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:39.375584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.376727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb9a031-7e45-4c82-8fbe-b6c1af8ca314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.379695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 888/1772] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:39 2022] DELETE /identity/v3/projects/5633a13ebc7d48e19cd0ab949162e4e0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:39.383486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:39.399672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709493d-bec6-4bcb-94fd-2788c2ce5e81 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:39.431788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:39.540681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa05d48-1539-40b3-b8d1-c81d0fe09e0a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:39.541722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa05d48-1539-40b3-b8d1-c81d0fe09e0a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:39.542533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa05d48-1539-40b3-b8d1-c81d0fe09e0a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:39.544544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:39.547232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 889/1773] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:32:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:32:39.550169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:39.553073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:39.553073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] PATH_INFO: `/v3/users/a4c2b5ec88234b4cb60ef846c16f9e23` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:39.558276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c2b5ec88234b4cb60ef846c16f9e23)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:39.560545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:39.596916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:39.597624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:39.598058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:39.648995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:39.655220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:39.697907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c2b5ec88234b4cb60ef846c16f9e23'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.725584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c2b5ec88234b4cb60ef846c16f9e23'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.785305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c2b5ec88234b4cb60ef846c16f9e23'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.829199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 890/1774] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:32:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:39.830100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:39.830909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c2b5ec88234b4cb60ef846c16f9e23'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.831677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:39.836000 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c2b5ec88234b4cb60ef846c16f9e23'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:39.855997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e549f-be4a-47c1-a427-9d43969ecb36 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:39.858613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 885/1775] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:39 2022] DELETE /identity/v3/users/a4c2b5ec88234b4cb60ef846c16f9e23 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:39.889454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:39.891021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:39.940045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:39.940922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:39.941142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:39.941450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] PATH_INFO: `/v3/projects/ad0dbce21ff044e988a87ffc5488dafc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:39.942825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0dbce21ff044e988a87ffc5488dafc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:39.945024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:39.990955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:40.035374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0dbce21ff044e988a87ffc5488dafc', 'request_id': 'req-ef555a64-b4be-42a7-83f0-277cb4ff1c09'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.053849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0dbce21ff044e988a87ffc5488dafc', 'request_id': 'req-ef555a64-b4be-42a7-83f0-277cb4ff1c09'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.097050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0dbce21ff044e988a87ffc5488dafc', 'request_id': 'req-ef555a64-b4be-42a7-83f0-277cb4ff1c09'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.132250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] The token cache is being invalidate because project ad0dbce21ff044e988a87ffc5488dafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:40.132546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.135379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.144772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 891/1776] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:39 2022] DELETE /identity/v3/projects/ad0dbce21ff044e988a87ffc5488dafc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:40.148532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:40.151526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:40.206372 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4057ea-2c58-4216-a33b-0762575860b5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:40.280180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef555a64-b4be-42a7-83f0-277cb4ff1c09 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:40.285573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:40.286306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:40.286597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:40.286876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] PATH_INFO: `/v3/users/aca0fcd8078749338cb59b82ab8b0baa` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:40.288199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca0fcd8078749338cb59b82ab8b0baa)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:40.290547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:40.298076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:40.389858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:40.392412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:40.393258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:40.394655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:40.397571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:40.412939 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca0fcd8078749338cb59b82ab8b0baa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.430965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca0fcd8078749338cb59b82ab8b0baa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.439218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:40.449571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:40.455013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca0fcd8078749338cb59b82ab8b0baa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.477071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 886/1777] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:40.524195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca0fcd8078749338cb59b82ab8b0baa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.528408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6a1f5c0f-55a6-429e-acff-e1133f2c2da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca0fcd8078749338cb59b82ab8b0baa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:40.549714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 892/1778] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:40 2022] DELETE /identity/v3/users/aca0fcd8078749338cb59b82ab8b0baa => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:41.477008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:41.479211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:41.517973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a20f9-9841-47a8-9d80-761190b8ba14 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:41.682999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:41.683563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:41.683897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:41.684179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] PATH_INFO: `/v3/projects/81264b8ae9ee46efb6ebf113d9bd0d61` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:41.685568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81264b8ae9ee46efb6ebf113d9bd0d61)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:41.687530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:41.791181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81264b8ae9ee46efb6ebf113d9bd0d61', 'request_id': 'req-cbced719-6b42-4ff7-8850-6c96bedab698'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:41.805484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81264b8ae9ee46efb6ebf113d9bd0d61', 'request_id': 'req-cbced719-6b42-4ff7-8850-6c96bedab698'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:41.832903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81264b8ae9ee46efb6ebf113d9bd0d61', 'request_id': 'req-cbced719-6b42-4ff7-8850-6c96bedab698'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:41.854710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] The token cache is being invalidate because project 81264b8ae9ee46efb6ebf113d9bd0d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:41.855005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:41.856909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cbced719-6b42-4ff7-8850-6c96bedab698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:41.859751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 887/1779] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:41 2022] DELETE /identity/v3/projects/81264b8ae9ee46efb6ebf113d9bd0d61 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:41.865330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867d45-bee2-4d44-951e-7d9b4914e885 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:41.865900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867d45-bee2-4d44-951e-7d9b4914e885 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:41.865900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867d45-bee2-4d44-951e-7d9b4914e885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:41.917410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8e867d45-bee2-4d44-951e-7d9b4914e885 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:41.929751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8e867d45-bee2-4d44-951e-7d9b4914e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:42.012943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:42.097364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 893/1780] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:42.098948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:42.099239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:42.099523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:42.121131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff84283-7902-49b0-865d-ba5922bc0f81 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:42.121812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff84283-7902-49b0-865d-ba5922bc0f81 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:42.122291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff84283-7902-49b0-865d-ba5922bc0f81 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:42.124497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 894/1781] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:32:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:32:42.147050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf57d6-0e0a-4a90-baa8-9ecd8371513f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:42.147676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf57d6-0e0a-4a90-baa8-9ecd8371513f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:42.148299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf57d6-0e0a-4a90-baa8-9ecd8371513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:42.178122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:42.181594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:42.215300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-07bf57d6-0e0a-4a90-baa8-9ecd8371513f None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:42.218123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-07bf57d6-0e0a-4a90-baa8-9ecd8371513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:42.236964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 888/1782] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:42.238052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:42.245912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:42.276843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e8b7c-662d-4c15-8362-011e764f5853 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:42.291547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:42.292235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:42.292519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:42.293411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] PATH_INFO: `/v3/projects/31e984726ee14708ad85ee2b3bc8c751` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:42.294259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e984726ee14708ad85ee2b3bc8c751)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:42.296227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:42.414932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:42.447011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e984726ee14708ad85ee2b3bc8c751', 'request_id': 'req-8b4cc043-d2e5-4236-a7a8-c2c933913bac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:42.472635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e984726ee14708ad85ee2b3bc8c751', 'request_id': 'req-8b4cc043-d2e5-4236-a7a8-c2c933913bac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:42.502187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e984726ee14708ad85ee2b3bc8c751', 'request_id': 'req-8b4cc043-d2e5-4236-a7a8-c2c933913bac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:42.516001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 895/1783] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:32:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:42.518376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf57d6-0e0a-4a90-baa8-9ecd8371513f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:42.527622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] The token cache is being invalidate because project 31e984726ee14708ad85ee2b3bc8c751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:42.535044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:42.536902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:42.539725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 889/1784] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:42 2022] DELETE /identity/v3/projects/31e984726ee14708ad85ee2b3bc8c751 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:42.542150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:42.551282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:42.555342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf57d6-0e0a-4a90-baa8-9ecd8371513f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:42.782008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d385b8-3f3c-48f1-9794-401cc4c0272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:42.782731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d385b8-3f3c-48f1-9794-401cc4c0272a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:42.783053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d385b8-3f3c-48f1-9794-401cc4c0272a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:42.783396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d385b8-3f3c-48f1-9794-401cc4c0272a admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:42.788555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d385b8-3f3c-48f1-9794-401cc4c0272a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:42.788848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d385b8-3f3c-48f1-9794-401cc4c0272a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:42.792080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc043-d2e5-4236-a7a8-c2c933913bac admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:42.795295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d385b8-3f3c-48f1-9794-401cc4c0272a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:42.813294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:42.813998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:42.814278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:42.814691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] PATH_INFO: `/v3/projects/636239acce3a43498e4f9ff4eea6fecb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:42.817857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=636239acce3a43498e4f9ff4eea6fecb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:42.819818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:42.830903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 896/1785] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:42.831245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:42.831534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:42.833448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:42.896908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:42.898235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:42.930724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 897/1786] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:42.930724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:42.932267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:42.983296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636239acce3a43498e4f9ff4eea6fecb', 'request_id': 'req-3e6942a1-e732-448a-80ee-6c055ecfe51e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:43.014221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636239acce3a43498e4f9ff4eea6fecb', 'request_id': 'req-3e6942a1-e732-448a-80ee-6c055ecfe51e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:43.043840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636239acce3a43498e4f9ff4eea6fecb', 'request_id': 'req-3e6942a1-e732-448a-80ee-6c055ecfe51e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:43.105319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] The token cache is being invalidate because project 636239acce3a43498e4f9ff4eea6fecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:43.105644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:43.109137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:43.123283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 890/1787] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:42 2022] DELETE /identity/v3/projects/636239acce3a43498e4f9ff4eea6fecb => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:43.123487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:43.124734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:43.131518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:43.194505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc55b8-b747-4f7d-ac84-c2bdb9fd54a9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:43.358603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c517fc-8b97-4669-987f-9b5a41d8e430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:43.359665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c517fc-8b97-4669-987f-9b5a41d8e430 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.359949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c517fc-8b97-4669-987f-9b5a41d8e430 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.360226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c517fc-8b97-4669-987f-9b5a41d8e430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.363000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-92c517fc-8b97-4669-987f-9b5a41d8e430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:43.367949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:43.378021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c517fc-8b97-4669-987f-9b5a41d8e430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:43.379672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c517fc-8b97-4669-987f-9b5a41d8e430 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:43.393584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 898/1788] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:43.408568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577fc37-60fc-4c2b-9a47-7a12602c9627 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.409169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577fc37-60fc-4c2b-9a47-7a12602c9627 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.409641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577fc37-60fc-4c2b-9a47-7a12602c9627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.424244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6942a1-e732-448a-80ee-6c055ecfe51e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:43.439495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a577fc37-60fc-4c2b-9a47-7a12602c9627 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:43.440743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a577fc37-60fc-4c2b-9a47-7a12602c9627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:43.447130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a83c5a-b2e9-4dff-b2ec-493b0bd14080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:43.447826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83c5a-b2e9-4dff-b2ec-493b0bd14080 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.454902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 899/1789] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:43.455114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83c5a-b2e9-4dff-b2ec-493b0bd14080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.455114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83c5a-b2e9-4dff-b2ec-493b0bd14080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.455249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0b4a-4254-4eb7-928d-b38ca6643b12 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.455316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a83c5a-b2e9-4dff-b2ec-493b0bd14080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:43.455405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0b4a-4254-4eb7-928d-b38ca6643b12 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.455405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0b4a-4254-4eb7-928d-b38ca6643b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.463999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a83c5a-b2e9-4dff-b2ec-493b0bd14080 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:43.477769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-608e0b4a-4254-4eb7-928d-b38ca6643b12 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:43.479006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-608e0b4a-4254-4eb7-928d-b38ca6643b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:43.509639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 900/1790] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:43.511454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e0b4a-4254-4eb7-928d-b38ca6643b12 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:43.546401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e0b4a-4254-4eb7-928d-b38ca6643b12 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:43.563170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:43.564036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.566785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.567215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.568066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:43.569518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:43.574875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:43.591473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 891/1791] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:43 2022] POST /identity/v3/projects => generated 373 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:43.602936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762aa36-a6cf-47f0-832a-dece99ec6435 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.603258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762aa36-a6cf-47f0-832a-dece99ec6435 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.606486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762aa36-a6cf-47f0-832a-dece99ec6435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.631527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 901/1792] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:43.632710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:43.647874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0025fc5-51e4-4bd7-85d7-4dcec2b56f5c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:43.694424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3762aa36-a6cf-47f0-832a-dece99ec6435 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:43.700820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3762aa36-a6cf-47f0-832a-dece99ec6435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:43.742423 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:43.744791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.745945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.746401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.749152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:43.754963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:43.812610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 902/1793] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:43 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:43.813791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:43.836995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa46b-acc3-41da-985b-f457883dd911 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:43.853430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:43.855300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:43.857335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:43.858196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:43.860075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:43.869263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:43.945994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 892/1794] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:43.945994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762aa36-a6cf-47f0-832a-dece99ec6435 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:43.959369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 903/1795] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:43 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:43.964424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:43.976927 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762aa36-a6cf-47f0-832a-dece99ec6435 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.018637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:44.074154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.075457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.076091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.076596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.078116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.081079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.096775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 893/1796] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:44.098074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.113264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e202c9-52cd-4d97-803e-c70c8776a31f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.120524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.121526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.122237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.122666 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.123803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:44.124440 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.126568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.139911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f99a0-60cd-406a-822d-44a77f4b00e9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.148740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 894/1797] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:44.150641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.152723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.153525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.153913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.154298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.155081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.158651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.173934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8189d-f779-4afd-9856-e4dd5a5cc696 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.179019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.179839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.180289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.180716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.182415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.184453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.200150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 895/1798] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:44.201427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.215700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba074-9086-4645-a748-ea63694c1b3e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.222411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.224124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.224543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.225129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.226123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.228789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.242117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 904/1799] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:43 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:44.246983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.292724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d8f8b-df5b-4012-97ec-5eeb27297372 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.308412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.309170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.309479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.309753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] PATH_INFO: `/v3/projects/baba10eadd9e4c58bf4389eb513e9b0a/users/79d75688f0214a16b28588e170986a95/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.317337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 896/1800] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:44 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:44.324384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.352408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=baba10eadd9e4c58bf4389eb513e9b0a, user_id=79d75688f0214a16b28588e170986a95, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.356155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.385756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 905/1801] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:44 2022] PUT /identity/v3/projects/baba10eadd9e4c58bf4389eb513e9b0a/users/79d75688f0214a16b28588e170986a95/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:44.387161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.406788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:44.501673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55086-0dc1-4e76-b697-aa5ff619eef2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.530842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c23a35-6191-45ba-b867-60ba284a14dc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.554872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f7f8-0fd1-4931-a92f-73e4ad433180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.555962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f7f8-0fd1-4931-a92f-73e4ad433180 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.556420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f7f8-0fd1-4931-a92f-73e4ad433180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.556658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f7f8-0fd1-4931-a92f-73e4ad433180 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.557390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f7f8-0fd1-4931-a92f-73e4ad433180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.576540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f7f8-0fd1-4931-a92f-73e4ad433180 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.662119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 906/1802] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:44 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:44.667956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5934f-5b71-4653-be7d-57f25f777bfa None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.668279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5934f-5b71-4653-be7d-57f25f777bfa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.668568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5934f-5b71-4653-be7d-57f25f777bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.702070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.702747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.703089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.703449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.704219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.706266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.745983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 897/1803] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:44.748775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.770058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-61b5934f-5b71-4653-be7d-57f25f777bfa None None] MFA Rules not processed for user `79d75688f0214a16b28588e170986a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:44.771648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-61b5934f-5b71-4653-be7d-57f25f777bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:44.798553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb036-b7d0-491c-89c9-eb6091327662 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.809233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.809233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.809233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.809233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.809905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.812087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.913100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 898/1804] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:44.914240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:44.939759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2be8e-5fad-4f02-a4be-0be01a48b4f8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:44.950969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:44.951936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:44.962578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:44.962578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:44.962578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:44.962578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:44.992943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 899/1805] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:45.000161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.038213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b339572-0380-4df1-8caf-81d9e081fb19 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.054574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 907/1806] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:45.054574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5934f-5b71-4653-be7d-57f25f777bfa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.058027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.058920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.059363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.063673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.064828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.067650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.073111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:45.088250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5934f-5b71-4653-be7d-57f25f777bfa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.106747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.110125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 900/1807] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:45.112627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.118417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.118417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.118417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] PATH_INFO: `/v3/projects/9b9ada1784ed46adb0e5ae5de87a24f8/users/de61de6aa6564e958adf1378f63fc117/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.142169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125796f-1eb6-41d2-a21b-ac5586c71b6f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.151751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885229af-f204-4688-a9e0-38bdbaa737d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.153399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885229af-f204-4688-a9e0-38bdbaa737d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.154541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885229af-f204-4688-a9e0-38bdbaa737d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.155057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885229af-f204-4688-a9e0-38bdbaa737d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.155506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885229af-f204-4688-a9e0-38bdbaa737d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.159230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885229af-f204-4688-a9e0-38bdbaa737d6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.162342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9ada1784ed46adb0e5ae5de87a24f8, user_id=de61de6aa6564e958adf1378f63fc117, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.165239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.196277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 908/1808] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:45 2022] PUT /identity/v3/projects/9b9ada1784ed46adb0e5ae5de87a24f8/users/de61de6aa6564e958adf1378f63fc117/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:45.197238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.214826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 901/1809] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:45.216153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b2b3-4996-4549-bab5-e950da149466 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.216530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b2b3-4996-4549-bab5-e950da149466 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.216716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b2b3-4996-4549-bab5-e950da149466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.265114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bd08b2b3-4996-4549-bab5-e950da149466 None None] MFA Rules not processed for user `de61de6aa6564e958adf1378f63fc117`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:45.265114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bd08b2b3-4996-4549-bab5-e950da149466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:45.300884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540ab6c-c4ef-4f06-9c6c-fc12f2764184 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.338373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 902/1810] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:45.339039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08b2b3-4996-4549-bab5-e950da149466 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.356443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:45.418531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.419304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.420270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.422491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] PATH_INFO: `/v3/projects/d2f46df87a384cd199680ef2c39fd49a/users/f35bf08141514cbfb26dabde5e174341/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.449400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08b2b3-4996-4549-bab5-e950da149466 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.450107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f46df87a384cd199680ef2c39fd49a, user_id=f35bf08141514cbfb26dabde5e174341, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.453809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.457832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56df81-513e-46ca-9d99-9604aeedba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.458601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56df81-513e-46ca-9d99-9604aeedba3f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.458991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56df81-513e-46ca-9d99-9604aeedba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.459572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56df81-513e-46ca-9d99-9604aeedba3f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.460419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56df81-513e-46ca-9d99-9604aeedba3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.462513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56df81-513e-46ca-9d99-9604aeedba3f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.473699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 909/1811] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:45 2022] PUT /identity/v3/projects/d2f46df87a384cd199680ef2c39fd49a/users/f35bf08141514cbfb26dabde5e174341/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:45.475539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.486384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 903/1812] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:45.488108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928b00-3895-4f97-a7cc-3e3ffa915748 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.488397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928b00-3895-4f97-a7cc-3e3ffa915748 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.488679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928b00-3895-4f97-a7cc-3e3ffa915748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.521242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-41928b00-3895-4f97-a7cc-3e3ffa915748 None None] MFA Rules not processed for user `f35bf08141514cbfb26dabde5e174341`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:45.522523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-41928b00-3895-4f97-a7cc-3e3ffa915748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:45.565133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec437b-3ba4-43a5-8b10-ca2569aa99fa admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.570218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.570841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.571125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.571401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.572099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.574091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.590167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:45.595769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 904/1813] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:45.596622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928b00-3895-4f97-a7cc-3e3ffa915748 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.607202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 910/1814] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:45.607412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928b00-3895-4f97-a7cc-3e3ffa915748 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.608233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.666053 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.667300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.667821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.668117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.668833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.670597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.672686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b6d4-f22e-4715-b8ff-a79888bdbc65 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.677507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.678131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.678415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.678702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.679397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.681405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.685634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 905/1815] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:45.688659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.700640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a11994-1ff5-4d59-bdc4-1d64c1a90e55 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.706092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.706693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.707028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.707610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.708261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.710210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.715228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 911/1816] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:45.715228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.736714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 906/1817] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/users => generated 300 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:45.737566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.747114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:45.751035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320ede-54a0-4c09-9644-c152d2c0652d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.795397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c14090-25cc-42c1-b571-071e4425092d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.802371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.803014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.803324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.803595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] PATH_INFO: `/v3/projects/c639a4a09c954610a04fa79d2be8d120/users/ad03c47e83a4471ea6d34204071923f6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.811301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.811863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.812145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.812485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.813091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.815114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.820345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c639a4a09c954610a04fa79d2be8d120, user_id=ad03c47e83a4471ea6d34204071923f6, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.824764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.841971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 907/1818] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:45 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:45.842172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 912/1819] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:45 2022] PUT /identity/v3/projects/c639a4a09c954610a04fa79d2be8d120/users/ad03c47e83a4471ea6d34204071923f6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:45.843417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.843593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.853493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181a35-a7c5-4de2-a8cc-203ed3718bcd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.919670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5375-e2d0-4baa-b55a-6eff14f8d142 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.923181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.923941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.924144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.924425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.924949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.925124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.925763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.926104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.926447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.926758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.927275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.928942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.935178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:45.937438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 908/1820] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:45.938455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.950840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 913/1821] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:45.951688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.952110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea96ef9-e170-4dcc-813b-85cc6393c802 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.957674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.959009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.959319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.959625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.960296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.961926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.962282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc3c69-3add-40ac-820c-550c5e909ba5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.971685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.971685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.971685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.971685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] PATH_INFO: `/v3/projects/7530a7daa4aa47ef860a9893aef478d6/users/34f1880dde534b11a9165f579c8b037b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:45.972858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 909/1822] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:45.974167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:45.987592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cad83-cc4e-4547-9e91-8434a6abd334 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:45.989617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7530a7daa4aa47ef860a9893aef478d6, user_id=34f1880dde534b11a9165f579c8b037b, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:45.992322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:45.992809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:45.993526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:45.993807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:45.994079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] PATH_INFO: `/v3/projects/31d3a1c085604aaba140bfd20cdc9cbe/users/e24f9251803d4d2d8511bae9ef4513b6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.009249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 914/1823] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:45 2022] PUT /identity/v3/projects/7530a7daa4aa47ef860a9893aef478d6/users/34f1880dde534b11a9165f579c8b037b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:46.010167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.012990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d3a1c085604aaba140bfd20cdc9cbe, user_id=e24f9251803d4d2d8511bae9ef4513b6, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.015731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.033780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 910/1824] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:45 2022] PUT /identity/v3/projects/31d3a1c085604aaba140bfd20cdc9cbe/users/e24f9251803d4d2d8511bae9ef4513b6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:46.037645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.078978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d160-8f2c-4543-b937-fd4109c5c735 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.100541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:46.106909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a996-670e-4a48-9ab4-9064f803e92d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.113952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.114971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.115760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.116140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.117112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.119218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.134971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 911/1825] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:46.134971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.145630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e8c98-1cdb-426f-94de-8e4287998fed admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.150841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.151470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.151784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.152035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.152744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.155023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.163132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.163903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.164189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.164466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] PATH_INFO: `/v3/projects/c639a4a09c954610a04fa79d2be8d120/users/ad03c47e83a4471ea6d34204071923f6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.166536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c639a4a09c954610a04fa79d2be8d120, user_id=ad03c47e83a4471ea6d34204071923f6, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.168880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 912/1826] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:46.169822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.172709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.181717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ee054-2e22-46ec-a680-9cde6b5320ba admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.193165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 915/1827] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:46 2022] PUT /identity/v3/projects/c639a4a09c954610a04fa79d2be8d120/users/ad03c47e83a4471ea6d34204071923f6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:46.194741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.282350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd367a-fd1c-462e-bde8-3d1eff28d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.283095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd367a-fd1c-462e-bde8-3d1eff28d350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.284340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd367a-fd1c-462e-bde8-3d1eff28d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.284629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd367a-fd1c-462e-bde8-3d1eff28d350 admin admin] PATH_INFO: `/v3/projects/7530a7daa4aa47ef860a9893aef478d6/users/34f1880dde534b11a9165f579c8b037b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.286990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd367a-fd1c-462e-bde8-3d1eff28d350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7530a7daa4aa47ef860a9893aef478d6, user_id=34f1880dde534b11a9165f579c8b037b, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.289839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd367a-fd1c-462e-bde8-3d1eff28d350 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.296073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552fbf-7b10-4cd2-b9c5-6dc926e0bcac admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.309491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 913/1828] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:46 2022] PUT /identity/v3/projects/7530a7daa4aa47ef860a9893aef478d6/users/34f1880dde534b11a9165f579c8b037b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:46.309491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a1ab8-19f5-44ec-b5a5-08f77ba5e796 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.309491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a1ab8-19f5-44ec-b5a5-08f77ba5e796 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.309491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a1ab8-19f5-44ec-b5a5-08f77ba5e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.325436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:46.344728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0b8a1ab8-19f5-44ec-b5a5-08f77ba5e796 None None] MFA Rules not processed for user `ad03c47e83a4471ea6d34204071923f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:46.346269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b8a1ab8-19f5-44ec-b5a5-08f77ba5e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:46.372627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc6955-5be0-4c4c-a447-39173c6f7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.378651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6955-5be0-4c4c-a447-39173c6f7fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.378651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6955-5be0-4c4c-a447-39173c6f7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.378651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6955-5be0-4c4c-a447-39173c6f7fad admin admin] PATH_INFO: `/v3/projects/31d3a1c085604aaba140bfd20cdc9cbe/users/e24f9251803d4d2d8511bae9ef4513b6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.378651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc6955-5be0-4c4c-a447-39173c6f7fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d3a1c085604aaba140bfd20cdc9cbe, user_id=e24f9251803d4d2d8511bae9ef4513b6, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.379102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc6955-5be0-4c4c-a447-39173c6f7fad admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.389862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 916/1829] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:46 2022] PUT /identity/v3/projects/31d3a1c085604aaba140bfd20cdc9cbe/users/e24f9251803d4d2d8511bae9ef4513b6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:46.400095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.400095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.400095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.421514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] MFA Rules not processed for user `34f1880dde534b11a9165f579c8b037b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:46.422856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:46.431751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 914/1830] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:46.433212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.433535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.433817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.467168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] MFA Rules not processed for user `e24f9251803d4d2d8511bae9ef4513b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:46.468431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:46.507883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 917/1831] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:46.510143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.513248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:46.524890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:46.560087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 915/1832] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:46.560087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.560087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:46.579246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd13f3-1295-4ffc-b02e-1643eaccb2ca None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.585568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.586281 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.586626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.587162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.633221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112719-5bea-4d0d-b918-69aa9d422674 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.637275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.638107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.638397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.638664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.649952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.651517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.654668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:46.659834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.661854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.663595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 916/1833] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:46.672971 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 918/1834] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:46.701822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.712252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb49a2-1b95-4fe4-af0a-04dcc4e9c6f4 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.716074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7436c2-bf8c-4ddd-b3e5-aa7aa7cb0770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.716719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7436c2-bf8c-4ddd-b3e5-aa7aa7cb0770 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.716994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7436c2-bf8c-4ddd-b3e5-aa7aa7cb0770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.717274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7436c2-bf8c-4ddd-b3e5-aa7aa7cb0770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.727073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7436c2-bf8c-4ddd-b3e5-aa7aa7cb0770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.728505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7436c2-bf8c-4ddd-b3e5-aa7aa7cb0770 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.742295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 917/1835] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:46.821724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:46.906604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234a9b9-b996-45a0-97db-e5870d3a94ea service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:46.911844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:46.912580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:46.912863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:46.913137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] PATH_INFO: `/v3/users/f35bf08141514cbfb26dabde5e174341` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:46.914479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35bf08141514cbfb26dabde5e174341)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:46.916534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:46.978251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35bf08141514cbfb26dabde5e174341'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:46.990092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35bf08141514cbfb26dabde5e174341'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.002004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35bf08141514cbfb26dabde5e174341'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.021877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35bf08141514cbfb26dabde5e174341'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.022900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35bf08141514cbfb26dabde5e174341'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.035932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 919/1836] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:46 2022] DELETE /identity/v3/users/f35bf08141514cbfb26dabde5e174341 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:47.040824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.041119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.041429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.067902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:47.069261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.199072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 918/1837] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:47.206933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:47.208731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.222275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9bf8-65fa-40f4-8a1f-1f8204f764a9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:47.225150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:47.226646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.227122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:47.227774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.228053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.228326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] PATH_INFO: `/v3/users/79d75688f0214a16b28588e170986a95` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.229512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d75688f0214a16b28588e170986a95)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:47.231448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:47.293731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d75688f0214a16b28588e170986a95'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.295149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613784-edee-46d2-94dd-b98581ab1378 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:47.299641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbaea-4ef4-471f-ba36-8a1232b2e9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:47.300277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbaea-4ef4-471f-ba36-8a1232b2e9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.300675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbaea-4ef4-471f-ba36-8a1232b2e9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.301034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbaea-4ef4-471f-ba36-8a1232b2e9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.304124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d75688f0214a16b28588e170986a95'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.313041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dbaea-4ef4-471f-ba36-8a1232b2e9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:47.314720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dbaea-4ef4-471f-ba36-8a1232b2e9c5 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:47.317745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d75688f0214a16b28588e170986a95'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.325518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 919/1838] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:47.325836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:47.362194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d75688f0214a16b28588e170986a95'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.363266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d75688f0214a16b28588e170986a95'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.377432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 920/1839] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:47 2022] DELETE /identity/v3/users/79d75688f0214a16b28588e170986a95 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:47.384302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.384607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.384892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.423620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:47.426022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.464009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:47.500715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:47.502650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.570457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 920/1840] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:47.583137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:47.585425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.617771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77a06-07ea-4eb1-a9a9-63f8c66af040 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:47.624749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:47.625537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.626019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.626405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] PATH_INFO: `/v3/users/de61de6aa6564e958adf1378f63fc117` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.628047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de61de6aa6564e958adf1378f63fc117)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:47.630864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:47.676865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a43f4-2416-44d2-97c9-c9ec396491e6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:47.687709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:47.688550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.688834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.689139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.712409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:47.714087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:47.728162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de61de6aa6564e958adf1378f63fc117'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.740851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de61de6aa6564e958adf1378f63fc117'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.750703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 921/1841] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:47.752031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:47.752826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de61de6aa6564e958adf1378f63fc117'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.762423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.772153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de61de6aa6564e958adf1378f63fc117'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.773330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2c0658c8-3c89-4e79-93ab-845a3a2b75b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de61de6aa6564e958adf1378f63fc117'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.781349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 921/1842] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:47 2022] DELETE /identity/v3/users/de61de6aa6564e958adf1378f63fc117 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:47.786411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.788352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.788737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.801653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b33b17-9579-4f73-8508-60c5683d6d0e service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:47.813251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:47.814674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.878963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:47.879680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:47.880010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:47.880290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] PATH_INFO: `/v3/projects/d2f46df87a384cd199680ef2c39fd49a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:47.881521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f46df87a384cd199680ef2c39fd49a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:47.883567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:47.911627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 922/1843] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:47.921861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:47.923431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:47.931775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:47.956295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f46df87a384cd199680ef2c39fd49a', 'request_id': 'req-d64c5c3a-ef04-47a3-8240-e468be6ac525'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.966772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f46df87a384cd199680ef2c39fd49a', 'request_id': 'req-d64c5c3a-ef04-47a3-8240-e468be6ac525'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.971153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:47.978082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f46df87a384cd199680ef2c39fd49a', 'request_id': 'req-d64c5c3a-ef04-47a3-8240-e468be6ac525'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.993381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] The token cache is being invalidate because project d2f46df87a384cd199680ef2c39fd49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:47.994102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.994428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:47.997334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 922/1844] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:47 2022] DELETE /identity/v3/projects/d2f46df87a384cd199680ef2c39fd49a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:48.000854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:48.003077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.021847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c972ada-c380-4733-bee6-7e32a3dfa463 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:48.081251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5c3a-ef04-47a3-8240-e468be6ac525 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:48.088683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:48.089384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.089672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.089787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:48.089953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] PATH_INFO: `/v3/users/e24f9251803d4d2d8511bae9ef4513b6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:48.090545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.090827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.091100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:48.091370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24f9251803d4d2d8511bae9ef4513b6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:48.092895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.093073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:48.106034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:48.107642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:48.118377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 923/1845] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:48.120107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:48.121329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.133757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a80a4-fbec-4d5b-b20e-7b72d2ee177f service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:48.138933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:48.139584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.139860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.140136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] PATH_INFO: `/v3/projects/baba10eadd9e4c58bf4389eb513e9b0a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:48.141361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baba10eadd9e4c58bf4389eb513e9b0a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:48.143368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:48.163074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24f9251803d4d2d8511bae9ef4513b6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.174269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24f9251803d4d2d8511bae9ef4513b6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.188758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24f9251803d4d2d8511bae9ef4513b6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.199158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24f9251803d4d2d8511bae9ef4513b6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.200039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24f9251803d4d2d8511bae9ef4513b6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.202592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baba10eadd9e4c58bf4389eb513e9b0a', 'request_id': 'req-e65af7d4-3785-4db7-8ec6-5550af3cf828'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.208737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 923/1846] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:47 2022] DELETE /identity/v3/users/e24f9251803d4d2d8511bae9ef4513b6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:48.213669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baba10eadd9e4c58bf4389eb513e9b0a', 'request_id': 'req-e65af7d4-3785-4db7-8ec6-5550af3cf828'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.220877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baba10eadd9e4c58bf4389eb513e9b0a', 'request_id': 'req-e65af7d4-3785-4db7-8ec6-5550af3cf828'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.243015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] The token cache is being invalidate because project baba10eadd9e4c58bf4389eb513e9b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:48.243589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.244547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.246434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 924/1847] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:48 2022] DELETE /identity/v3/projects/baba10eadd9e4c58bf4389eb513e9b0a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:48.250235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:48.252959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.349532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b46e9-fda8-4b30-9e74-f5ac9e81ddbf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:48.357933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:48.358713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.359135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.359497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] PATH_INFO: `/v3/users/ad03c47e83a4471ea6d34204071923f6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:48.361480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad03c47e83a4471ea6d34204071923f6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:48.364736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:48.384622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:48.427172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:48.428650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.465402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad03c47e83a4471ea6d34204071923f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.478760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad03c47e83a4471ea6d34204071923f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.497344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad03c47e83a4471ea6d34204071923f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.504922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad03c47e83a4471ea6d34204071923f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.505710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad03c47e83a4471ea6d34204071923f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.512396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 924/1848] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:48 2022] DELETE /identity/v3/users/ad03c47e83a4471ea6d34204071923f6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:32:48.515403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:48.543015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65af7d4-3785-4db7-8ec6-5550af3cf828 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:48.619627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:48.621089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.634702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:48.636177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.637121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.637709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] PATH_INFO: `/v3/projects/9b9ada1784ed46adb0e5ae5de87a24f8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:48.639636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9ada1784ed46adb0e5ae5de87a24f8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:48.642068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:48.707745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71196ccc-05a4-4777-b324-32808b648b48 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:48.714919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:48.715754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.716131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.716505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] PATH_INFO: `/v3/projects/31d3a1c085604aaba140bfd20cdc9cbe` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:48.717941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d3a1c085604aaba140bfd20cdc9cbe)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:48.719921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:48.731512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9ada1784ed46adb0e5ae5de87a24f8', 'request_id': 'req-42ccf944-431f-4e84-b651-8569e0b4bcfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.741577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9ada1784ed46adb0e5ae5de87a24f8', 'request_id': 'req-42ccf944-431f-4e84-b651-8569e0b4bcfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.749235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9ada1784ed46adb0e5ae5de87a24f8', 'request_id': 'req-42ccf944-431f-4e84-b651-8569e0b4bcfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.769862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] The token cache is being invalidate because project 9b9ada1784ed46adb0e5ae5de87a24f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:48.770378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.771224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.773212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 925/1849] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:48 2022] DELETE /identity/v3/projects/9b9ada1784ed46adb0e5ae5de87a24f8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:32:48.776921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:48.777799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d3a1c085604aaba140bfd20cdc9cbe', 'request_id': 'req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.778812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.800209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d3a1c085604aaba140bfd20cdc9cbe', 'request_id': 'req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.814742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d3a1c085604aaba140bfd20cdc9cbe', 'request_id': 'req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.840459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] The token cache is being invalidate because project 31d3a1c085604aaba140bfd20cdc9cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:48.841067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.841841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-97e3fc70-a3f9-48d8-b9d7-a8293bb81065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:48.844247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 925/1850] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:48 2022] DELETE /identity/v3/projects/31d3a1c085604aaba140bfd20cdc9cbe => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:48.849447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.849794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.850075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:48.874034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:48.875755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:48.892047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf944-431f-4e84-b651-8569e0b4bcfc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:48.897302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:48.947118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:48.993324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 926/1851] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:48.994048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:48.997606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:48.998462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:48.998746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:48.999021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] PATH_INFO: `/v3/users/34f1880dde534b11a9165f579c8b037b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.000272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f1880dde534b11a9165f579c8b037b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.002470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.002585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.016207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ed71f-baf4-4f44-a763-cec78cf5ecdb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.021419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.022089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.022377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.022665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] PATH_INFO: `/v3/projects/c639a4a09c954610a04fa79d2be8d120` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.024773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c639a4a09c954610a04fa79d2be8d120)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.027447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.071087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f1880dde534b11a9165f579c8b037b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.081169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f1880dde534b11a9165f579c8b037b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.093185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c639a4a09c954610a04fa79d2be8d120', 'request_id': 'req-a1e2e871-3907-4756-9a48-b5d30aa6c488'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.095352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f1880dde534b11a9165f579c8b037b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.112598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f1880dde534b11a9165f579c8b037b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.112944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c639a4a09c954610a04fa79d2be8d120', 'request_id': 'req-a1e2e871-3907-4756-9a48-b5d30aa6c488'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.113614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7028c1e-1c1b-4472-8cd4-2c65ca7d86e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f1880dde534b11a9165f579c8b037b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.125333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 926/1852] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:48 2022] DELETE /identity/v3/users/34f1880dde534b11a9165f579c8b037b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:32:49.125333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51feaf-2cc6-4358-a4f8-c44ab8062cc0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.125333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51feaf-2cc6-4358-a4f8-c44ab8062cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.125723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51feaf-2cc6-4358-a4f8-c44ab8062cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.126003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c639a4a09c954610a04fa79d2be8d120', 'request_id': 'req-a1e2e871-3907-4756-9a48-b5d30aa6c488'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.140002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] The token cache is being invalidate because project c639a4a09c954610a04fa79d2be8d120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:49.140457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.141382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1e2e871-3907-4756-9a48-b5d30aa6c488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.143259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 927/1853] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:48 2022] DELETE /identity/v3/projects/c639a4a09c954610a04fa79d2be8d120 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:49.148018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7bf0e-776e-40f7-a28a-22fcc6c2819d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.148311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7bf0e-776e-40f7-a28a-22fcc6c2819d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.148595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7bf0e-776e-40f7-a28a-22fcc6c2819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.173448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9e51feaf-2cc6-4358-a4f8-c44ab8062cc0 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:49.174641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bdd7bf0e-776e-40f7-a28a-22fcc6c2819d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:49.175493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9e51feaf-2cc6-4358-a4f8-c44ab8062cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.176255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bdd7bf0e-776e-40f7-a28a-22fcc6c2819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.269319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 928/1854] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:32:49.276909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70516c5b-b377-4aa8-8493-049fae17e2c7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.276909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70516c5b-b377-4aa8-8493-049fae17e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.276909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70516c5b-b377-4aa8-8493-049fae17e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.278138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 927/1855] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:49.279063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51feaf-2cc6-4358-a4f8-c44ab8062cc0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.300627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51feaf-2cc6-4358-a4f8-c44ab8062cc0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.302829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-70516c5b-b377-4aa8-8493-049fae17e2c7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:49.304551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-70516c5b-b377-4aa8-8493-049fae17e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.310081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.310740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.311024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.311303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.312751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:49.313063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.318066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.321566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 929/1856] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:49.325387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70516c5b-b377-4aa8-8493-049fae17e2c7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.340764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70516c5b-b377-4aa8-8493-049fae17e2c7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.340901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 928/1857] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:49.345575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.349966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.351084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.351713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.352580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.354142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:49.354752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.357015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.359955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2135-e298-4e3c-bcc5-6d43770d5e9b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.376727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 930/1858] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:32:49.377771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.378496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.378839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.379178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.380137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.381983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.382257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.393453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbf5b5-d7a0-4476-818e-8e3fda7fcc36 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.398298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.398926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.399377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.399690 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.400813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.403129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.419057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 929/1859] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:32:49.420252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.447570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 931/1860] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:49.449465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.451077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.455041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:49.457001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:49.517068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79bae7-83a3-43d4-bb4d-2c529b01d8f2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.534327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a999-fee7-4b9e-8a9f-ab5ebb717123 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.540417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.541587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.542091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.542757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] PATH_INFO: `/v3/projects/7530a7daa4aa47ef860a9893aef478d6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.543981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7530a7daa4aa47ef860a9893aef478d6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.546581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.580706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.581565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.581875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.582592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.583390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.585447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.602324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7530a7daa4aa47ef860a9893aef478d6', 'request_id': 'req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.608060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7530a7daa4aa47ef860a9893aef478d6', 'request_id': 'req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.615946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7530a7daa4aa47ef860a9893aef478d6', 'request_id': 'req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.618453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 930/1861] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:49.619277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.628775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] The token cache is being invalidate because project 7530a7daa4aa47ef860a9893aef478d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:49.629064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.629176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260c707-7768-4b6c-bcb6-bce71a34c44b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.629771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:49.631489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 932/1862] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:49 2022] DELETE /identity/v3/projects/7530a7daa4aa47ef860a9893aef478d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:49.632395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.633700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.687349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb47ebd-d26d-44c6-825b-c6d7c8b2c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.687898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47ebd-d26d-44c6-825b-c6d7c8b2c14f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.688191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47ebd-d26d-44c6-825b-c6d7c8b2c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.688471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47ebd-d26d-44c6-825b-c6d7c8b2c14f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.689161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb47ebd-d26d-44c6-825b-c6d7c8b2c14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.691208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb47ebd-d26d-44c6-825b-c6d7c8b2c14f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.696169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd8207-16d9-40a6-aa6c-4a77d3d9098e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.700669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.701304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.701598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.701880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.702577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.704159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.716435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 931/1863] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:49.716612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 933/1864] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:49.717044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ea2c-603b-424a-9769-3f68d01268fc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.717044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ea2c-603b-424a-9769-3f68d01268fc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.717044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ea2c-603b-424a-9769-3f68d01268fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.718418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.720212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.732991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cbf8a-c85c-4655-a036-7872a8744ede admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.734830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fad9ea2c-603b-424a-9769-3f68d01268fc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:49.736056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fad9ea2c-603b-424a-9769-3f68d01268fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.737806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c377-6dde-44a6-a2b0-6ba26e2d3093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.738417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c377-6dde-44a6-a2b0-6ba26e2d3093 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.738729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c377-6dde-44a6-a2b0-6ba26e2d3093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.739007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c377-6dde-44a6-a2b0-6ba26e2d3093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.739700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193c377-6dde-44a6-a2b0-6ba26e2d3093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.741345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193c377-6dde-44a6-a2b0-6ba26e2d3093 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.744301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 932/1865] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:49.752289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9ea2c-603b-424a-9769-3f68d01268fc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.752990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 934/1866] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:49.754316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622462b5-9582-4afc-89d0-110129338df3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.754606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622462b5-9582-4afc-89d0-110129338df3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.754882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622462b5-9582-4afc-89d0-110129338df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.755146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9ea2c-603b-424a-9769-3f68d01268fc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.760323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.761187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.761580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.761923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.762894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.765509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.774496 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-622462b5-9582-4afc-89d0-110129338df3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:49.775699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-622462b5-9582-4afc-89d0-110129338df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:49.780221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 933/1867] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:49.780221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.783999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 935/1868] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:49.784791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622462b5-9582-4afc-89d0-110129338df3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.788527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f0431-7413-44a8-8144-f7ce8a258c1a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.793870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.794105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622462b5-9582-4afc-89d0-110129338df3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.794507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.794787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.795060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.795747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.797459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.800689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.802758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.802758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.802758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] PATH_INFO: `/v3/projects/4349562653d744f0a6a5c6c11f2e20e5/users/d20a9348b61249308cfca0d45ce3efab/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.809566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 934/1869] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:49.810410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.814886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:49.821919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4349562653d744f0a6a5c6c11f2e20e5, user_id=d20a9348b61249308cfca0d45ce3efab, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.822067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca328-a641-4d77-af27-7142218b65ed admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.824771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.826949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.827811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.828100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.828512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.831232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:49.831560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.833754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.845497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:49.850499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 935/1870] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:49.851861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.867236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 936/1871] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:49 2022] PUT /identity/v3/projects/4349562653d744f0a6a5c6c11f2e20e5/users/d20a9348b61249308cfca0d45ce3efab/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:49.869098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d32983-4979-40db-9630-d8b19800295b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.871442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:49.951532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187f7f-6198-43f2-9203-1ece00f3b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.952357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187f7f-6198-43f2-9203-1ece00f3b538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.952639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187f7f-6198-43f2-9203-1ece00f3b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.952913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187f7f-6198-43f2-9203-1ece00f3b538 admin admin] PATH_INFO: `/v3/projects/6cd25edaf3dc4940b399c541b2d38934/users/dcbef5e6379d4c38a0f899306d22f7c8/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.960345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d871e-44ee-4165-b53c-38f9abf3ee7d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:49.966258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3bfb1-ebaf-4bc0-a979-735dbb811c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:49.967215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bfb1-ebaf-4bc0-a979-735dbb811c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:49.967708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bfb1-ebaf-4bc0-a979-735dbb811c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:49.968383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bfb1-ebaf-4bc0-a979-735dbb811c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:49.969362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bfb1-ebaf-4bc0-a979-735dbb811c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.971426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bfb1-ebaf-4bc0-a979-735dbb811c90 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:49.976579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f187f7f-6198-43f2-9203-1ece00f3b538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd25edaf3dc4940b399c541b2d38934, user_id=dcbef5e6379d4c38a0f899306d22f7c8, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:49.980139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f187f7f-6198-43f2-9203-1ece00f3b538 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.042018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 936/1872] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:49 2022] PUT /identity/v3/projects/6cd25edaf3dc4940b399c541b2d38934/users/dcbef5e6379d4c38a0f899306d22f7c8/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:50.042018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb4aff-50dc-41bd-bb3c-07784dd3ced5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.043836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 937/1873] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:49 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:50.045195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb4aff-50dc-41bd-bb3c-07784dd3ced5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.045351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f2bc2-d05c-4062-acce-8756ae9d7e2d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.045622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f2bc2-d05c-4062-acce-8756ae9d7e2d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.045780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb4aff-50dc-41bd-bb3c-07784dd3ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.045925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f2bc2-d05c-4062-acce-8756ae9d7e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.080045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-526f2bc2-d05c-4062-acce-8756ae9d7e2d None None] MFA Rules not processed for user `dcbef5e6379d4c38a0f899306d22f7c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:50.080891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fbbb4aff-50dc-41bd-bb3c-07784dd3ced5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:50.081484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-526f2bc2-d05c-4062-acce-8756ae9d7e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:50.084187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fbbb4aff-50dc-41bd-bb3c-07784dd3ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:50.153132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 938/1874] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:50.154016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f2bc2-d05c-4062-acce-8756ae9d7e2d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.163296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 937/1875] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:50.163296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb4aff-50dc-41bd-bb3c-07784dd3ced5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.170758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb4aff-50dc-41bd-bb3c-07784dd3ced5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.170949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f2bc2-d05c-4062-acce-8756ae9d7e2d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.175457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.176096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.176374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.176471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.176658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.176999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.177298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.177391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.177595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.178274 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.179256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.180290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.203157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 939/1876] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:50 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:50.203941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.205560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:50.216077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 938/1877] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:50 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:50.217189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.263058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:50.276950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401527a-1dfc-4fdf-814b-46b8f591b711 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.292416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5e2c-3b38-4dc5-b4a6-4d826f26bb08 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.298164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.299051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.299576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.300028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.301101 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.302884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.305245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:50.314749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 939/1878] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:50.318626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.328667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af15a32-89c5-4b0b-9ff1-e36655b9ca09 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.333962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.334424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.334747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.335040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.335163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.335319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.335470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.335751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.336417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.338672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.345391 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.346871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.356665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 940/1879] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:50.357529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.362552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 940/1880] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:50 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:50.366446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.367083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b54e2c-1a01-4ef3-a531-24820cb7934f service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.371848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.372603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.372891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.373171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.373905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.377120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d193945-9ab7-4f91-807b-398aa55a94e9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.383096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.383534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.384344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.384773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.385358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.386788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.388872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.397886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 941/1881] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:50.403277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.426839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39c8ca-51e6-49f0-85ca-13ffc0a8b95c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.429114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 941/1882] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:50.430542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.442999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d629a74-5c26-4f25-a4a4-0db3a9e82e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.443870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629a74-5c26-4f25-a4a4-0db3a9e82e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.444159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629a74-5c26-4f25-a4a4-0db3a9e82e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.444438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629a74-5c26-4f25-a4a4-0db3a9e82e85 admin admin] PATH_INFO: `/v3/projects/e975c3c7016d4d8eb02ce32d3c199e2f/users/1385b32b1f474f11a329c0082139e6b9/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.455989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091381f-91e4-4683-bf6d-0d727ce34f12 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.463265 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.464279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.464761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.465957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] PATH_INFO: `/v3/projects/97792a6afd0d4cfea364448d54f3d6a9/users/63395cf973f947ad9154f6544f950b22/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.475818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d629a74-5c26-4f25-a4a4-0db3a9e82e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e975c3c7016d4d8eb02ce32d3c199e2f, user_id=1385b32b1f474f11a329c0082139e6b9, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.479922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d629a74-5c26-4f25-a4a4-0db3a9e82e85 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.488051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=97792a6afd0d4cfea364448d54f3d6a9, user_id=63395cf973f947ad9154f6544f950b22, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.492168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.504748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 942/1883] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:50 2022] PUT /identity/v3/projects/e975c3c7016d4d8eb02ce32d3c199e2f/users/1385b32b1f474f11a329c0082139e6b9/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:50.513639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.514141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.514494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.517487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 942/1884] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:50 2022] PUT /identity/v3/projects/97792a6afd0d4cfea364448d54f3d6a9/users/63395cf973f947ad9154f6544f950b22/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:50.523303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.549535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] MFA Rules not processed for user `1385b32b1f474f11a329c0082139e6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:50.551174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:50.622765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95684aa1-ad90-447a-844f-c255f1270bad admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.632629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.633215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.633582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.633801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.634529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.636198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.653008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 943/1885] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:50.654103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.661950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 943/1886] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:32:50.666217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a6c50-3fea-4e40-b34d-efd2889f33f3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.671723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b00c0c-cdd4-4473-aedf-f95ab369c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.672479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b00c0c-cdd4-4473-aedf-f95ab369c1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.672836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b00c0c-cdd4-4473-aedf-f95ab369c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.673183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b00c0c-cdd4-4473-aedf-f95ab369c1d1 admin admin] PATH_INFO: `/v3/projects/97792a6afd0d4cfea364448d54f3d6a9/users/63395cf973f947ad9154f6544f950b22/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.674078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.675861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:50.676339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b00c0c-cdd4-4473-aedf-f95ab369c1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97792a6afd0d4cfea364448d54f3d6a9, user_id=63395cf973f947ad9154f6544f950b22, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.679897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b00c0c-cdd4-4473-aedf-f95ab369c1d1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.692880 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 944/1887] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:50 2022] PUT /identity/v3/projects/97792a6afd0d4cfea364448d54f3d6a9/users/63395cf973f947ad9154f6544f950b22/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:50.704387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.705905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.706509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.750005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] MFA Rules not processed for user `63395cf973f947ad9154f6544f950b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:50.751253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:50.774096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:50.805851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343b45-aeed-41b0-b44d-d8e8c75fea27 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.857553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 945/1888] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:50.871732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:50.873411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:50.880971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ca4a7-2c2d-4845-b423-c0fc38ffc6fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.881678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ca4a7-2c2d-4845-b423-c0fc38ffc6fc service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.881968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ca4a7-2c2d-4845-b423-c0fc38ffc6fc service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.882289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ca4a7-2c2d-4845-b423-c0fc38ffc6fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.892077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:50.951688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34102a0d-d650-4c39-b831-46ff22373c80 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:50.955704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:50.956434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:50.956850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:50.957639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:50.967371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.968986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.975345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ca4a7-2c2d-4845-b423-c0fc38ffc6fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:50.977633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ca4a7-2c2d-4845-b423-c0fc38ffc6fc service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:50.979871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 946/1889] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:50.989733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 944/1890] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:51.030474 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:51.047460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c268-4b32-4ca6-b2d9-ceff44afc36c service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:51.057051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:51.057786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:51.058133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:51.058473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:51.148002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:51.149498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:51.171972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 947/1891] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:51.658212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ffcf4-3cdc-4e00-a61b-61bebea6e953 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:51.658771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ffcf4-3cdc-4e00-a61b-61bebea6e953 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:51.659334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ffcf4-3cdc-4e00-a61b-61bebea6e953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:51.694853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-257ffcf4-3cdc-4e00-a61b-61bebea6e953 None None] MFA Rules not processed for user `d20a9348b61249308cfca0d45ce3efab`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:51.696085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-257ffcf4-3cdc-4e00-a61b-61bebea6e953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:51.767692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 945/1892] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:51.772398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:51.846011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712a59e-c428-4600-9b25-e80dee1126a2 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:51.853138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:51.853798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:51.854079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:51.854376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:51.855101 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:51.857021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:51.888307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 948/1893] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:51 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:32:51.894603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ffcf4-3cdc-4e00-a61b-61bebea6e953 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:51.908138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ffcf4-3cdc-4e00-a61b-61bebea6e953 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:51.948799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:51.977310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:51.977941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:51.978223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:51.978497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:51.979168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:51.981161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:52.002815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 946/1894] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:51 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:52.007059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:52.017807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adf0a2-06ab-43d9-b0fc-3aa6a4eae681 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:52.022690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:52.023295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:52.023563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:52.023881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:52.024576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:52.026213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:52.037143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 949/1895] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:52.041530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:52.052030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb36d6-e340-46ed-b862-6519482301fb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:52.057138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:52.057881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:52.058163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:52.058445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] PATH_INFO: `/v3/projects/35660580695c4591b4561d7ed8ebf9b2/users/b036a3a7fc044397a3160417f77bdf7c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:52.076108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35660580695c4591b4561d7ed8ebf9b2, user_id=b036a3a7fc044397a3160417f77bdf7c, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:52.078820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:52.095795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 947/1896] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:52 2022] PUT /identity/v3/projects/35660580695c4591b4561d7ed8ebf9b2/users/b036a3a7fc044397a3160417f77bdf7c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:52.099952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:52.112131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc2e1b-271c-4f69-854f-bc1f52055a5a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:52.144505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:52.177098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d61561-3199-48b0-92c5-89f4ae48f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:52.177759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61561-3199-48b0-92c5-89f4ae48f172 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:52.178033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61561-3199-48b0-92c5-89f4ae48f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:52.178304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61561-3199-48b0-92c5-89f4ae48f172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:52.179076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d61561-3199-48b0-92c5-89f4ae48f172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:52.181782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d61561-3199-48b0-92c5-89f4ae48f172 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:52.196414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 950/1897] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:52.197698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:52.208731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc3926-7ea2-42f8-b568-bfd485f39c4f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:52.213584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:52.214294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:52.214574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:52.214849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] PATH_INFO: `/v3/projects/35660580695c4591b4561d7ed8ebf9b2/users/b036a3a7fc044397a3160417f77bdf7c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:52.216796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35660580695c4591b4561d7ed8ebf9b2, user_id=b036a3a7fc044397a3160417f77bdf7c, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:52.219424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:52.230036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 948/1898] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:52 2022] PUT /identity/v3/projects/35660580695c4591b4561d7ed8ebf9b2/users/b036a3a7fc044397a3160417f77bdf7c/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:52.898323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d426-f64d-4763-989a-f4cb6613d87e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:52.898832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d426-f64d-4763-989a-f4cb6613d87e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:52.898977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d426-f64d-4763-989a-f4cb6613d87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:52.931966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4f38d426-f64d-4763-989a-f4cb6613d87e None None] MFA Rules not processed for user `b036a3a7fc044397a3160417f77bdf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:52.933207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4f38d426-f64d-4763-989a-f4cb6613d87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:53.016422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 951/1899] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:53.028318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:53.031021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:53.099729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9c35-9bcb-4833-a1a0-ae7c43e54f1c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:53.104277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb51ca8-d0a1-4e9e-8296-8d40d2e81298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:53.105338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51ca8-d0a1-4e9e-8296-8d40d2e81298 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:53.105938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51ca8-d0a1-4e9e-8296-8d40d2e81298 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:53.106122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51ca8-d0a1-4e9e-8296-8d40d2e81298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:53.168419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb51ca8-d0a1-4e9e-8296-8d40d2e81298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:53.169840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb51ca8-d0a1-4e9e-8296-8d40d2e81298 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:53.182489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 949/1900] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:54.815323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d426-f64d-4763-989a-f4cb6613d87e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:54.901316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d426-f64d-4763-989a-f4cb6613d87e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:54.908320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:54.909005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:54.909953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:54.910343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] PATH_INFO: `/v3/users/dcbef5e6379d4c38a0f899306d22f7c8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:54.911595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbef5e6379d4c38a0f899306d22f7c8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:54.915010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:55.044647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbef5e6379d4c38a0f899306d22f7c8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.071577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:55.077546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbef5e6379d4c38a0f899306d22f7c8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.090001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbef5e6379d4c38a0f899306d22f7c8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.108304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbef5e6379d4c38a0f899306d22f7c8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.109395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbef5e6379d4c38a0f899306d22f7c8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.116227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 952/1901] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:54 2022] DELETE /identity/v3/users/dcbef5e6379d4c38a0f899306d22f7c8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:55.120817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:55.121348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:55.121522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:55.143924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:55.145470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:55.191696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:55.221347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 950/1902] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:55.230814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:55.232244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:55.295844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d295b-722b-48e5-bf4a-d56465e52303 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:55.302259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:55.302909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:55.303186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:55.303454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:55.313234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:55.314784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:55.324063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 953/1903] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:55.628821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:55.630288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:55.651234 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017e20-0f6c-4355-b12e-208173e99733 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:55.656699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:55.657407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:55.657743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:55.658023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] PATH_INFO: `/v3/projects/6cd25edaf3dc4940b399c541b2d38934` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:55.659280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd25edaf3dc4940b399c541b2d38934)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:55.661198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:55.709809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd25edaf3dc4940b399c541b2d38934', 'request_id': 'req-ff63843d-f1d1-4168-aad2-7dbed1aefd91'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.715494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd25edaf3dc4940b399c541b2d38934', 'request_id': 'req-ff63843d-f1d1-4168-aad2-7dbed1aefd91'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.723448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd25edaf3dc4940b399c541b2d38934', 'request_id': 'req-ff63843d-f1d1-4168-aad2-7dbed1aefd91'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.735178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] The token cache is being invalidate because project 6cd25edaf3dc4940b399c541b2d38934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:55.735495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.736137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.737728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 951/1904] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:55 2022] DELETE /identity/v3/projects/6cd25edaf3dc4940b399c541b2d38934 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:55.741915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:55.752139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1883-781f-4a81-976a-69ba5ee822c4 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:55.817930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:55.818637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:55.818874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:55.819150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] PATH_INFO: `/v3/users/63395cf973f947ad9154f6544f950b22` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:55.820316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63395cf973f947ad9154f6544f950b22)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:55.822522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:55.877221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63395cf973f947ad9154f6544f950b22'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.884543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63395cf973f947ad9154f6544f950b22'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.894463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63395cf973f947ad9154f6544f950b22'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.903671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:55.909032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63395cf973f947ad9154f6544f950b22'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.909761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eeb79bd2-b398-4346-95b5-a8b15b0bfdf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63395cf973f947ad9154f6544f950b22'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:55.921385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 954/1905] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:55 2022] DELETE /identity/v3/users/63395cf973f947ad9154f6544f950b22 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:32:56.252909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.254441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:56.278547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63843d-f1d1-4168-aad2-7dbed1aefd91 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.353297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.354099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.354395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.354679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] PATH_INFO: `/v3/projects/97792a6afd0d4cfea364448d54f3d6a9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.355847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97792a6afd0d4cfea364448d54f3d6a9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.358284 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.435106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97792a6afd0d4cfea364448d54f3d6a9', 'request_id': 'req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:56.440918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97792a6afd0d4cfea364448d54f3d6a9', 'request_id': 'req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:56.449254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97792a6afd0d4cfea364448d54f3d6a9', 'request_id': 'req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:56.457362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:56.464112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] The token cache is being invalidate because project 97792a6afd0d4cfea364448d54f3d6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:56.464434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:56.466427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c31e4dd7-75f7-43e6-8cee-3d3462c6366e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:56.468435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 952/1906] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:56 2022] DELETE /identity/v3/projects/97792a6afd0d4cfea364448d54f3d6a9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:56.473585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889333-2a37-428a-9564-2915d1c3c2cd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.473882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889333-2a37-428a-9564-2915d1c3c2cd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.474185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889333-2a37-428a-9564-2915d1c3c2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.494817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-42889333-2a37-428a-9564-2915d1c3c2cd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:56.496040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-42889333-2a37-428a-9564-2915d1c3c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:56.557943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 955/1907] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:56.564365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ae15-e9d7-4cca-815d-bb1df0e0b614 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.564699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ae15-e9d7-4cca-815d-bb1df0e0b614 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.564986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ae15-e9d7-4cca-815d-bb1df0e0b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.585961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-87b3ae15-e9d7-4cca-815d-bb1df0e0b614 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:56.587167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-87b3ae15-e9d7-4cca-815d-bb1df0e0b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:56.595787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 953/1908] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:56.600329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889333-2a37-428a-9564-2915d1c3c2cd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.610889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889333-2a37-428a-9564-2915d1c3c2cd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.617188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.617840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.618125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.618550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.619085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:56.619389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.621038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.634484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 956/1909] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:56.639294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3ae15-e9d7-4cca-815d-bb1df0e0b614 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.649155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3ae15-e9d7-4cca-815d-bb1df0e0b614 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.655162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.655874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.656247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.656550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.657226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.659213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.689594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.689594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:56.693452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 954/1910] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:56 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:56.694439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.747186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce9c02-88aa-436b-bdfe-eae01a963b78 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.764121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8aa1-db0e-4a95-9244-91b106670c50 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.768878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.769531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.769818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.770094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.770782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.772718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.798526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 955/1911] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:56 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:32:56.798856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1acc0-21bd-422a-a9b7-3e9bc25b02e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.799301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1acc0-21bd-422a-a9b7-3e9bc25b02e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.799582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1acc0-21bd-422a-a9b7-3e9bc25b02e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.799680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.799857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1acc0-21bd-422a-a9b7-3e9bc25b02e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.801793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4ff1acc0-21bd-422a-a9b7-3e9bc25b02e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:56.814292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bcceb-49df-4b6f-9fbc-a2f9792b62f2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.819060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.819794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.820078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.820356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.821063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.822711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.836713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 956/1912] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:56.837768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.847191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad1ef8-13e2-41ba-9a55-55670698238d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.851682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.851889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:56.852344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.852566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.852848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.853727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.855262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.866970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 957/1913] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:56.869298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1acc0-21bd-422a-a9b7-3e9bc25b02e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.873793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1acc0-21bd-422a-a9b7-3e9bc25b02e4 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.873957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:56.882663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6f185-f574-4cba-86ac-aca10b3c3d0d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:56.887337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:56.887518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 957/1914] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:56.888085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.888369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.888647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] PATH_INFO: `/v3/projects/e207c4bdd9444a77b089b1f21d37c892/users/343d3765ae7c44aab4cff023b47ea7eb/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.903752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e207c4bdd9444a77b089b1f21d37c892, user_id=343d3765ae7c44aab4cff023b47ea7eb, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:56.906497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:56.920509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 958/1915] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:56 2022] PUT /identity/v3/projects/e207c4bdd9444a77b089b1f21d37c892/users/343d3765ae7c44aab4cff023b47ea7eb/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:32:56.931254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef274f-baf2-4b7f-8d27-12bc9e76ac4a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:56.931549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef274f-baf2-4b7f-8d27-12bc9e76ac4a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:56.931828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef274f-baf2-4b7f-8d27-12bc9e76ac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:56.972567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-16ef274f-baf2-4b7f-8d27-12bc9e76ac4a None None] MFA Rules not processed for user `343d3765ae7c44aab4cff023b47ea7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:56.975869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-16ef274f-baf2-4b7f-8d27-12bc9e76ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:57.085018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 958/1916] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:57.098974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.223538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39e651-7c7f-4d6a-a21f-acad8df804d0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.234028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:57.235034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.235465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.235893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.236868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:57.239111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:57.268827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:57.278737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 959/1917] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:57 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:57.282685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef274f-baf2-4b7f-8d27-12bc9e76ac4a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.293733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef274f-baf2-4b7f-8d27-12bc9e76ac4a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.358520 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:57.359155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.359436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.360333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.360455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:57.362624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:57.389335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 959/1918] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:57 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:57.393149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.404432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca62f9d-2d65-4d3e-a6aa-3e2de0d9542f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.409571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:57.410212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.410498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.410808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.411831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:57.413874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:57.426708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 960/1919] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:57.430896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.444437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39889524-06b4-48f6-8529-f8351b1a65f0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.451323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:57.452021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.452370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.452705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] PATH_INFO: `/v3/projects/c8b5ca983a844096aae9b7a1927f171d/users/cfecc83337c14d83ba4a71a81b87dc77/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.466514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.468567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:57.473432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b5ca983a844096aae9b7a1927f171d, user_id=cfecc83337c14d83ba4a71a81b87dc77, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:57.476075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:57.487040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5fc5-1ce4-4113-9c11-36dc1b6a3ea9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.492726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:57.493442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.493749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.493993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] PATH_INFO: `/v3/users/3168c01f27fb49c9a8f62993e3d681e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.496008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3168c01f27fb49c9a8f62993e3d681e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:57.504381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 960/1920] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:57 2022] PUT /identity/v3/projects/c8b5ca983a844096aae9b7a1927f171d/users/cfecc83337c14d83ba4a71a81b87dc77/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:57.506086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:57.506372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.591647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:57.606204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3168c01f27fb49c9a8f62993e3d681e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:57.618395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3168c01f27fb49c9a8f62993e3d681e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:57.640727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673b0f-c683-40dc-953f-bb8950f92423 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.646695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3168c01f27fb49c9a8f62993e3d681e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:57.649131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:57.649876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.650091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.650373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.651089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:57.653328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:57.658219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3168c01f27fb49c9a8f62993e3d681e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:57.660179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-79b38d9c-0146-40d4-9d38-b067f6810e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3168c01f27fb49c9a8f62993e3d681e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:57.671377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 961/1921] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:57 2022] DELETE /identity/v3/users/3168c01f27fb49c9a8f62993e3d681e5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:32:57.677058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.677655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.678882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.690181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 961/1922] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:57.701783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.703825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:57.706447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:57.708919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:57.718871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9624c-e9d8-4583-93df-997e4b3a8b8e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.786252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e710daa-098b-4137-9377-058c6a818625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:57.787250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e710daa-098b-4137-9377-058c6a818625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.787669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e710daa-098b-4137-9377-058c6a818625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.788085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e710daa-098b-4137-9377-058c6a818625 admin admin] PATH_INFO: `/v3/projects/c8b5ca983a844096aae9b7a1927f171d/users/cfecc83337c14d83ba4a71a81b87dc77/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.790242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e710daa-098b-4137-9377-058c6a818625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b5ca983a844096aae9b7a1927f171d, user_id=cfecc83337c14d83ba4a71a81b87dc77, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:57.793053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e710daa-098b-4137-9377-058c6a818625 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:57.804580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 962/1923] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:57 2022] PUT /identity/v3/projects/c8b5ca983a844096aae9b7a1927f171d/users/cfecc83337c14d83ba4a71a81b87dc77/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:57.817909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:57.818464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:57.825331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:57.832458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 962/1924] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:57.842918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:57.844479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:57.864458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] MFA Rules not processed for user `cfecc83337c14d83ba4a71a81b87dc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:57.871106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:57.936902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac1d3-9b54-4a72-a9f0-52ee71e73589 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:57.956660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:57.987508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 963/1925] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:32:58.001386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:58.002998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:58.006464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:58.007312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:58.007735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:58.008200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:58.072274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b6f7-d5b0-44f5-b1a4-4b1c2b9aa9d8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:58.075948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:58.076454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:58.076559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:58.076777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:58.077054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:58.078020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:58.086329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:58.087765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:58.088088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 963/1926] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:32:58.091900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:58.100494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 964/1927] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:58.157613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:58.159312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:58.174427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414a64f-3171-482b-8e7f-5474565406d3 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:58.178339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:58.178974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:58.179268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:58.179527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:58.181608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:58.245134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:58.246669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:58.265083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 964/1928] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:32:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:32:58.461602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:58.463337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:58.489336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65223d8-c9b5-48f4-9e83-d72984212d74 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:58.507198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:58.507890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:58.508182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:58.508828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] PATH_INFO: `/v3/projects/ee1bfa578fec4f569c2662588b1df15c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:58.510957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1bfa578fec4f569c2662588b1df15c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:58.513448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:58.598169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1bfa578fec4f569c2662588b1df15c', 'request_id': 'req-9e3307ea-9400-4a22-ae71-a51d181a351f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.607542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1bfa578fec4f569c2662588b1df15c', 'request_id': 'req-9e3307ea-9400-4a22-ae71-a51d181a351f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.637367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1bfa578fec4f569c2662588b1df15c', 'request_id': 'req-9e3307ea-9400-4a22-ae71-a51d181a351f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.682231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] The token cache is being invalidate because project ee1bfa578fec4f569c2662588b1df15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:58.682640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.688237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.690633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 965/1929] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:58 2022] DELETE /identity/v3/projects/ee1bfa578fec4f569c2662588b1df15c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:58.694559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:58.726644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47f20-6a4a-4a5e-b392-d52f4f4f7e1a service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:58.835861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:58.836404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:58.836900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:58.837351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] PATH_INFO: `/v3/users/d02dafa825ee4d51a726423a5f1af62c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:58.838686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02dafa825ee4d51a726423a5f1af62c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:58.841160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:58.846688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:58.942469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02dafa825ee4d51a726423a5f1af62c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.952316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02dafa825ee4d51a726423a5f1af62c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.968433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02dafa825ee4d51a726423a5f1af62c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.975339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02dafa825ee4d51a726423a5f1af62c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.976061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-561223ed-9789-45b9-8acc-bd4598f4f277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02dafa825ee4d51a726423a5f1af62c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:58.981916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 965/1930] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:32:58 2022] DELETE /identity/v3/users/d02dafa825ee4d51a726423a5f1af62c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:59.283700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:59.285447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:59.299252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3307ea-9400-4a22-ae71-a51d181a351f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:59.365580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:59.366345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.366672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.366952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] PATH_INFO: `/v3/projects/a804d7ad5f6349d78296427674ba2b5e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.368568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a804d7ad5f6349d78296427674ba2b5e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:59.370254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:59.434708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a804d7ad5f6349d78296427674ba2b5e', 'request_id': 'req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:59.445115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a804d7ad5f6349d78296427674ba2b5e', 'request_id': 'req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:59.453398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a804d7ad5f6349d78296427674ba2b5e', 'request_id': 'req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:59.466146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] The token cache is being invalidate because project a804d7ad5f6349d78296427674ba2b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:32:59.466541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:59.467249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a3ed6bb-a113-4757-a79c-a40a48d4ea94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:32:59.468844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 966/1931] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:32:59 2022] DELETE /identity/v3/projects/a804d7ad5f6349d78296427674ba2b5e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:59.474134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8f61-dc17-4b81-ab4c-3631dc551057 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.474383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8f61-dc17-4b81-ab4c-3631dc551057 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.474667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8f61-dc17-4b81-ab4c-3631dc551057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.495576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c0aa8f61-dc17-4b81-ab4c-3631dc551057 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:59.496791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c0aa8f61-dc17-4b81-ab4c-3631dc551057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:59.555964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 966/1932] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:59.565511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf035-25e8-4d54-9a41-e515edb4041e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.565764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf035-25e8-4d54-9a41-e515edb4041e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.566173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf035-25e8-4d54-9a41-e515edb4041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.593604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0debf035-25e8-4d54-9a41-e515edb4041e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:32:59.594818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0debf035-25e8-4d54-9a41-e515edb4041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:32:59.603079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 967/1933] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:32:59.607363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8f61-dc17-4b81-ab4c-3631dc551057 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:59.617735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8f61-dc17-4b81-ab4c-3631dc551057 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:59.622979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:59.623631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.623913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.624186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.624898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:32:59.625264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:59.626925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:59.642962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 967/1934] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:32:59.647819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debf035-25e8-4d54-9a41-e515edb4041e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:59.653882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:59.657936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debf035-25e8-4d54-9a41-e515edb4041e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:59.664190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:59.664812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.665097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.665414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.666592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:59.668512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:59.698660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 968/1935] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:32:59 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:32:59.703024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:59.713955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5a057-abb2-40b0-971f-9fa3a80e0bfe admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:59.772298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:59.772926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.773216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.773524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.774206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:59.776491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:59.794619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:59.801652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 968/1936] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:32:59 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:32:59.805999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:59.821484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598249-a108-408c-823e-06e52bb68e7e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:59.837867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:59.838509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.838830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.839109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.839821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:59.841466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:59.855259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 969/1937] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:32:59.856505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:59.867432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4422-a879-4595-8e3e-c8c1cb752bdb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:59.872972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27158e02-55d5-4158-a6cc-22038031c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:59.873934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27158e02-55d5-4158-a6cc-22038031c509 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.873934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27158e02-55d5-4158-a6cc-22038031c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.874325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27158e02-55d5-4158-a6cc-22038031c509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.875097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27158e02-55d5-4158-a6cc-22038031c509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:59.877547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27158e02-55d5-4158-a6cc-22038031c509 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:59.907649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 969/1938] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:32:59.908937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:32:59.919341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822658a-82b2-429d-961c-803fd2e004b3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:32:59.924856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:32:59.925573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.925854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.926128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] PATH_INFO: `/v3/projects/cdfbf87c21e546ffa8a2caa6ab085443/users/b1ec501ad9b945cca4a41fa67efec8e0/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:32:59.958422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfbf87c21e546ffa8a2caa6ab085443, user_id=b1ec501ad9b945cca4a41fa67efec8e0, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:32:59.961661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:32:59.983946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 970/1939] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:32:59 2022] PUT /identity/v3/projects/cdfbf87c21e546ffa8a2caa6ab085443/users/b1ec501ad9b945cca4a41fa67efec8e0/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:32:59.996962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc595e-663b-41f6-864d-a232ec445fe4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:32:59.997258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc595e-663b-41f6-864d-a232ec445fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:32:59.997565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc595e-663b-41f6-864d-a232ec445fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.033108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3fdc595e-663b-41f6-864d-a232ec445fe4 None None] MFA Rules not processed for user `b1ec501ad9b945cca4a41fa67efec8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:00.034405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3fdc595e-663b-41f6-864d-a232ec445fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:00.115185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 970/1940] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:32:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:00.116393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.210052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffdef6-4edf-4659-bcd7-ff762bc018ba admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.214838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.215472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.215755 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.216030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.216707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.218659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.220357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156bdd1-26d1-4c93-b9f9-831804651eb8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.220357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156bdd1-26d1-4c93-b9f9-831804651eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.220624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156bdd1-26d1-4c93-b9f9-831804651eb8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.222453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 971/1941] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 08:33:00.232095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.232422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.232638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.255401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 971/1942] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:00 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:00.262047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.267582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:00.268826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:00.331402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0a70-9d4a-47cb-a6f4-e419e1739f8a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.336873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.337629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.337909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.338181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.338907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.340962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.345244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 972/1943] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:33:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:00.358733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.360170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:00.366753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 972/1944] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:00 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:00.367840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.374853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad03f7-2815-4574-af24-7e11d8a5e33e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.378489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7807271-dea4-4a1c-9d3f-5f39f44a92ff admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.380681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.381462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.381745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.382083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.383243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.383855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.384136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.384408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.385106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.386738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.391120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.392918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.397700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 973/1945] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:00.401870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.403559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 973/1946] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:00.418159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c041018-f4a0-4d55-b91e-66bb6de6224e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.422866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.423579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.423926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.424204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] PATH_INFO: `/v3/projects/2ab9ad2a58044b0998bd76c3f5389b36/users/f34e1ccfc9424f4296575ba9ec613988/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.432787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:00.441992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab9ad2a58044b0998bd76c3f5389b36, user_id=f34e1ccfc9424f4296575ba9ec613988, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.445624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.463163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 974/1947] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:00 2022] PUT /identity/v3/projects/2ab9ad2a58044b0998bd76c3f5389b36/users/f34e1ccfc9424f4296575ba9ec613988/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:00.463980 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.480989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144a9a1-d836-426f-b8ff-8464aa40c905 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.529566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:00.536091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7343c6-767c-4e2f-9b99-743ea353f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.536728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7343c6-767c-4e2f-9b99-743ea353f705 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.537016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7343c6-767c-4e2f-9b99-743ea353f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.537311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7343c6-767c-4e2f-9b99-743ea353f705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.538023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7343c6-767c-4e2f-9b99-743ea353f705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.539893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7343c6-767c-4e2f-9b99-743ea353f705 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.555147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 974/1948] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:00.556315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.567149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9045f-8539-4ec5-a719-4d5bc9902192 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.572745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.573455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.573738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.574010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] PATH_INFO: `/v3/projects/2ab9ad2a58044b0998bd76c3f5389b36/users/f34e1ccfc9424f4296575ba9ec613988/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.576186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab9ad2a58044b0998bd76c3f5389b36, user_id=f34e1ccfc9424f4296575ba9ec613988, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.578873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.591278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 975/1949] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:00 2022] PUT /identity/v3/projects/2ab9ad2a58044b0998bd76c3f5389b36/users/f34e1ccfc9424f4296575ba9ec613988/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:00.601756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.601986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.602270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.638256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] MFA Rules not processed for user `f34e1ccfc9424f4296575ba9ec613988`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:00.639432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:00.718682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 975/1950] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:00.730982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:00.733007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:00.825898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b59c-8db3-499b-bf20-fd8de1c30d32 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:00.830388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:00.831024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:00.831315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:00.831581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:00.846246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:00.848051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:00.859873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 976/1951] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:01.038284 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:01.040086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:01.056944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259c3ea-b558-4d56-a946-00092f5796ed None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:01.060557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb6809-d26d-45da-aa50-ff41d3da27c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:01.061249 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6809-d26d-45da-aa50-ff41d3da27c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:01.061591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6809-d26d-45da-aa50-ff41d3da27c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:01.061865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6809-d26d-45da-aa50-ff41d3da27c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:01.132763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb6809-d26d-45da-aa50-ff41d3da27c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:01.134242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb6809-d26d-45da-aa50-ff41d3da27c8 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:01.144555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 976/1952] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:03.063844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:03.065383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:03.132519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9eb7b-9614-4481-bea2-6227b6508edd service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:03.138288 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:03.138948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:03.139256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:03.139527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] PATH_INFO: `/v3/users/343d3765ae7c44aab4cff023b47ea7eb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:03.140824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343d3765ae7c44aab4cff023b47ea7eb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:03.142851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:03.191143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343d3765ae7c44aab4cff023b47ea7eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.198024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343d3765ae7c44aab4cff023b47ea7eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.207469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343d3765ae7c44aab4cff023b47ea7eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.218351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:03.220094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343d3765ae7c44aab4cff023b47ea7eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.220749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343d3765ae7c44aab4cff023b47ea7eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.231374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 977/1953] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:03 2022] DELETE /identity/v3/users/343d3765ae7c44aab4cff023b47ea7eb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:03.233104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:03.233576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:03.233685 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:03.254251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:03.255482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:03.322321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 977/1954] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:03.332576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:03.334445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:03.397961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89e80e-24a9-44f6-8b7a-3d349a49cfe4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:03.401728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:03.402360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:03.402645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:03.402922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:03.413364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:03.414683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:03.425120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 978/1955] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:03.746675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:03.748146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:03.760446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32fa1d-d613-4f1b-adb7-3b18f3fc1840 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:03.775638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:03.776239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:03.776518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:03.776799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] PATH_INFO: `/v3/projects/e207c4bdd9444a77b089b1f21d37c892` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:03.778109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e207c4bdd9444a77b089b1f21d37c892)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:03.780038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:03.805267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:03.847778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e207c4bdd9444a77b089b1f21d37c892', 'request_id': 'req-55ee1cdc-1765-464e-b677-14c1527af655'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.853254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e207c4bdd9444a77b089b1f21d37c892', 'request_id': 'req-55ee1cdc-1765-464e-b677-14c1527af655'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.862494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e207c4bdd9444a77b089b1f21d37c892', 'request_id': 'req-55ee1cdc-1765-464e-b677-14c1527af655'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.875460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] The token cache is being invalidate because project e207c4bdd9444a77b089b1f21d37c892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:03.875808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.876680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:03.878538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 978/1956] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:03 2022] DELETE /identity/v3/projects/e207c4bdd9444a77b089b1f21d37c892 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:03.882778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:03.892660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0ab0-56cf-4bb6-8aad-a722cf43bfd9 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:03.953862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:03.954502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:03.954781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:03.955080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] PATH_INFO: `/v3/users/cfecc83337c14d83ba4a71a81b87dc77` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:03.956297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfecc83337c14d83ba4a71a81b87dc77)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:03.958600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.007176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfecc83337c14d83ba4a71a81b87dc77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.013801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfecc83337c14d83ba4a71a81b87dc77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.022464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfecc83337c14d83ba4a71a81b87dc77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.034819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfecc83337c14d83ba4a71a81b87dc77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.035559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e59a3899-08c7-40a1-af3c-d25aeee1f3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfecc83337c14d83ba4a71a81b87dc77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.041884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 979/1957] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:03 2022] DELETE /identity/v3/users/cfecc83337c14d83ba4a71a81b87dc77 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:04.326159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:04.328426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:04.350155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1cdc-1765-464e-b677-14c1527af655 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:04.411786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:04.412446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.412732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.413015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] PATH_INFO: `/v3/projects/c8b5ca983a844096aae9b7a1927f171d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.414243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b5ca983a844096aae9b7a1927f171d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:04.416169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.465943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b5ca983a844096aae9b7a1927f171d', 'request_id': 'req-0c779f7e-4666-423b-9c9b-b7d1975d7a57'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.472220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b5ca983a844096aae9b7a1927f171d', 'request_id': 'req-0c779f7e-4666-423b-9c9b-b7d1975d7a57'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.481569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b5ca983a844096aae9b7a1927f171d', 'request_id': 'req-0c779f7e-4666-423b-9c9b-b7d1975d7a57'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.492967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] The token cache is being invalidate because project c8b5ca983a844096aae9b7a1927f171d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:04.493261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.493998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0c779f7e-4666-423b-9c9b-b7d1975d7a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:04.495800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 979/1958] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:04 2022] DELETE /identity/v3/projects/c8b5ca983a844096aae9b7a1927f171d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:04.501088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a211f4-79fd-45a4-a166-5c61d1c5275b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.501557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a211f4-79fd-45a4-a166-5c61d1c5275b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.501699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a211f4-79fd-45a4-a166-5c61d1c5275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.521614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b6a211f4-79fd-45a4-a166-5c61d1c5275b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:04.523082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b6a211f4-79fd-45a4-a166-5c61d1c5275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:04.536261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:04.585341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 980/1959] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:04.593358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e722-2d03-477f-8ecf-a8cfe6f7ce96 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.593686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e722-2d03-477f-8ecf-a8cfe6f7ce96 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.593990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e722-2d03-477f-8ecf-a8cfe6f7ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.614780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0e54e722-2d03-477f-8ecf-a8cfe6f7ce96 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:04.616013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0e54e722-2d03-477f-8ecf-a8cfe6f7ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:04.624004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 980/1960] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:04.628549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a211f4-79fd-45a4-a166-5c61d1c5275b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:04.638356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a211f4-79fd-45a4-a166-5c61d1c5275b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:04.643584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:04.644249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.644531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.644846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.645615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:04.645923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:04.647596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.660123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 981/1961] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:04.664162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e722-2d03-477f-8ecf-a8cfe6f7ce96 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:04.673550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e722-2d03-477f-8ecf-a8cfe6f7ce96 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:04.678997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:04.679706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.679994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.680271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.680989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:04.683140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.713887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 981/1962] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:04 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:04.718028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:04.728953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b9b6d-04f3-429d-8b3f-997152e9841f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:04.786918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:04.787491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.787772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.788112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.788767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:04.790746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.815460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 982/1963] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:04 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:04.816778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:04.822466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:04.828896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0156-4605-4b1b-b669-951d99f23206 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:04.836287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:04.836918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.837213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.837528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.838239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:04.839859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.851322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 982/1964] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:04.855302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:04.867362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258d87-24b5-4180-94f8-b71aa677439f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:04.872802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a98860-3beb-4800-9f74-dc5e5b78dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:04.873442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98860-3beb-4800-9f74-dc5e5b78dab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.873742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98860-3beb-4800-9f74-dc5e5b78dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.874019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98860-3beb-4800-9f74-dc5e5b78dab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.874709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98860-3beb-4800-9f74-dc5e5b78dab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:04.876455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98860-3beb-4800-9f74-dc5e5b78dab4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.888846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 983/1965] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:04.893155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:04.908974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025b03-c9a9-44e6-ab85-915113fc1f7e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:04.913882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:04.914563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.914850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.915130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] PATH_INFO: `/v3/projects/e37b1c994aa8478397ca00b7c53d577a/users/ef09084b08124412a13fe6ac9403a09b/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.933819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37b1c994aa8478397ca00b7c53d577a, user_id=ef09084b08124412a13fe6ac9403a09b, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:04.937267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:04.953378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 983/1966] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:04 2022] PUT /identity/v3/projects/e37b1c994aa8478397ca00b7c53d577a/users/ef09084b08124412a13fe6ac9403a09b/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:04.965390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b263-25ac-4660-9b27-f082c49edbba None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:04.965677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b263-25ac-4660-9b27-f082c49edbba None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:04.965961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b263-25ac-4660-9b27-f082c49edbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:04.997040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ed74b263-25ac-4660-9b27-f082c49edbba None None] MFA Rules not processed for user `ef09084b08124412a13fe6ac9403a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:04.998314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ed74b263-25ac-4660-9b27-f082c49edbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:05.075821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 984/1967] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:05.080959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.156607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8bb9c-3a83-4e26-abfc-689132c334fe admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.161644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.162259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.162563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.162839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.163504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.165497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.194264 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 984/1968] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:05 2022] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:05.198685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b263-25ac-4660-9b27-f082c49edbba None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.210283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b263-25ac-4660-9b27-f082c49edbba None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.219892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:05.272130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.272766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.273049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.273366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.274032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.276028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.300039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 985/1969] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:05 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:05.304004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.317249 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3e695-607d-4fe3-b00b-eba20333e9d7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.322380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.323006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.323292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.323576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.324288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.326089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.337204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 985/1970] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:05.341447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.352399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093832b1-4d0a-4aaa-8ff2-cd746dd8653c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.358007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.358682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.358983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.359260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] PATH_INFO: `/v3/projects/c8bf7cbfe30740a6ade559e9ac04f107/users/7295c319f3c64fec9592e7f6fe255150/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.380609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bf7cbfe30740a6ade559e9ac04f107, user_id=7295c319f3c64fec9592e7f6fe255150, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.383215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.399443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 986/1971] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:05 2022] PUT /identity/v3/projects/c8bf7cbfe30740a6ade559e9ac04f107/users/7295c319f3c64fec9592e7f6fe255150/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:05.403707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.414273 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdffef-3985-4045-95b4-6d2551fc0f82 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.476529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a928e0-ccee-47f1-835b-84fb8d5b90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.477162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a928e0-ccee-47f1-835b-84fb8d5b90f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.477470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a928e0-ccee-47f1-835b-84fb8d5b90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.477735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a928e0-ccee-47f1-835b-84fb8d5b90f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.478430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a928e0-ccee-47f1-835b-84fb8d5b90f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.480027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a928e0-ccee-47f1-835b-84fb8d5b90f4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.490238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 986/1972] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:05.495023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.505999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14f91-1d21-4a4e-9e5e-99121006fca1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.510836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.511534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.511811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.512080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] PATH_INFO: `/v3/projects/c8bf7cbfe30740a6ade559e9ac04f107/users/7295c319f3c64fec9592e7f6fe255150/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.514935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bf7cbfe30740a6ade559e9ac04f107, user_id=7295c319f3c64fec9592e7f6fe255150, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.517487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.535500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 987/1973] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:05 2022] PUT /identity/v3/projects/c8bf7cbfe30740a6ade559e9ac04f107/users/7295c319f3c64fec9592e7f6fe255150/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:05.546096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1582e2-b61d-446d-ac9e-b28069576b85 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.546452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1582e2-b61d-446d-ac9e-b28069576b85 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.546734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1582e2-b61d-446d-ac9e-b28069576b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.574970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0d1582e2-b61d-446d-ac9e-b28069576b85 None None] MFA Rules not processed for user `7295c319f3c64fec9592e7f6fe255150`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:05.576226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0d1582e2-b61d-446d-ac9e-b28069576b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:05.601682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:05.644965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 987/1974] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:05.655988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.658039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:05.716617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd1b8-0598-46eb-9b97-d1bc9476fbcb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.720577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.721206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.721510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.721786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.731266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.732706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.742565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 988/1975] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:05.823507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1582e2-b61d-446d-ac9e-b28069576b85 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:05.833826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1582e2-b61d-446d-ac9e-b28069576b85 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:05.837722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a21bf-27a7-4b32-af87-840f33cc4646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:05.838356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a21bf-27a7-4b32-af87-840f33cc4646 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:05.838641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a21bf-27a7-4b32-af87-840f33cc4646 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:05.838918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a21bf-27a7-4b32-af87-840f33cc4646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:05.896585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a21bf-27a7-4b32-af87-840f33cc4646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:05.898054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a21bf-27a7-4b32-af87-840f33cc4646 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:05.908020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 988/1976] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:08.201589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:08.203266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:08.272285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc142d0-feea-4c56-b9d2-8c5b1e3e28b2 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:08.277825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:08.278523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:08.278927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:08.280701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] PATH_INFO: `/v3/users/b1ec501ad9b945cca4a41fa67efec8e0` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:08.281446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ec501ad9b945cca4a41fa67efec8e0)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:08.283556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:08.294861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:08.335281 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ec501ad9b945cca4a41fa67efec8e0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:08.343225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ec501ad9b945cca4a41fa67efec8e0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:08.351142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ec501ad9b945cca4a41fa67efec8e0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:08.363920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ec501ad9b945cca4a41fa67efec8e0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:08.364569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ec501ad9b945cca4a41fa67efec8e0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:08.370583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 989/1977] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:08 2022] DELETE /identity/v3/users/b1ec501ad9b945cca4a41fa67efec8e0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:08.375261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:08.375781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:08.375860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:08.397985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:08.399236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:08.468268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 989/1978] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:08.478210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:08.480107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:08.572368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7e51-fe49-41cb-bb61-5dbf8713950b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:08.576651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:08.581225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:08.581225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:08.581225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:08.593462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:08.596133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:08.609096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 990/1979] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:08.970393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:08.972036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:08.984311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a3dba-9d5c-4cfa-a07a-9cccfbe7291b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:08.989956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:08.990651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:08.990921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:08.991191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] PATH_INFO: `/v3/projects/cdfbf87c21e546ffa8a2caa6ab085443` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:08.992492 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfbf87c21e546ffa8a2caa6ab085443)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:08.994444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:09.053551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfbf87c21e546ffa8a2caa6ab085443', 'request_id': 'req-2d29731a-f42b-469d-bc6a-b432a37aefdc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.061022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:09.063070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfbf87c21e546ffa8a2caa6ab085443', 'request_id': 'req-2d29731a-f42b-469d-bc6a-b432a37aefdc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.077591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfbf87c21e546ffa8a2caa6ab085443', 'request_id': 'req-2d29731a-f42b-469d-bc6a-b432a37aefdc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.092079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] The token cache is being invalidate because project cdfbf87c21e546ffa8a2caa6ab085443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:09.092453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.093200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.094863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 990/1980] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:08 2022] DELETE /identity/v3/projects/cdfbf87c21e546ffa8a2caa6ab085443 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:09.099084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:09.109152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebafce-e06b-4e7f-ab2e-3019f7112af1 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:09.165654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:09.166316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:09.166592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:09.166865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] PATH_INFO: `/v3/users/f34e1ccfc9424f4296575ba9ec613988` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:09.168055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34e1ccfc9424f4296575ba9ec613988)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:09.169970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:09.209405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:09.228530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34e1ccfc9424f4296575ba9ec613988'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.244459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34e1ccfc9424f4296575ba9ec613988'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.259383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34e1ccfc9424f4296575ba9ec613988'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.275456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34e1ccfc9424f4296575ba9ec613988'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.276189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6413556c-c1c4-44af-a0d2-ad3bdc845faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34e1ccfc9424f4296575ba9ec613988'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.283712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 991/1981] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:09 2022] DELETE /identity/v3/users/f34e1ccfc9424f4296575ba9ec613988 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:09.594054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:09.596247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:09.616799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29731a-f42b-469d-bc6a-b432a37aefdc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:09.711553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:09.712567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:09.712917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:09.713323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] PATH_INFO: `/v3/projects/2ab9ad2a58044b0998bd76c3f5389b36` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:09.715085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab9ad2a58044b0998bd76c3f5389b36)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:09.717315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:09.770025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab9ad2a58044b0998bd76c3f5389b36', 'request_id': 'req-67257b29-6d89-425f-8b92-710de1d021a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.775735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab9ad2a58044b0998bd76c3f5389b36', 'request_id': 'req-67257b29-6d89-425f-8b92-710de1d021a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.784295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab9ad2a58044b0998bd76c3f5389b36', 'request_id': 'req-67257b29-6d89-425f-8b92-710de1d021a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.795895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] The token cache is being invalidate because project 2ab9ad2a58044b0998bd76c3f5389b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:09.796183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.796846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67257b29-6d89-425f-8b92-710de1d021a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:09.798430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 991/1982] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:09 2022] DELETE /identity/v3/projects/2ab9ad2a58044b0998bd76c3f5389b36 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:09.805381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4cb9c-2c41-4aa5-84a1-7babff464968 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:09.805859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4cb9c-2c41-4aa5-84a1-7babff464968 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:09.806146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4cb9c-2c41-4aa5-84a1-7babff464968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:09.832392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ebd4cb9c-2c41-4aa5-84a1-7babff464968 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:09.833775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ebd4cb9c-2c41-4aa5-84a1-7babff464968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:09.928971 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 992/1983] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:09.937378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125973a-836a-4380-8d90-1b7e0a60e473 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:09.937378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125973a-836a-4380-8d90-1b7e0a60e473 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:09.937378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125973a-836a-4380-8d90-1b7e0a60e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:09.960267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4125973a-836a-4380-8d90-1b7e0a60e473 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:09.961877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4125973a-836a-4380-8d90-1b7e0a60e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:09.971964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 992/1984] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:09.976365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4cb9c-2c41-4aa5-84a1-7babff464968 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:09.989872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4cb9c-2c41-4aa5-84a1-7babff464968 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:09.996409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:09.997073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:09.997381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:09.997664 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:09.998388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:09.998747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:10.001200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:10.014489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 993/1985] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:10.019263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125973a-836a-4380-8d90-1b7e0a60e473 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:10.029257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125973a-836a-4380-8d90-1b7e0a60e473 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:10.034071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:10.034701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:10.034982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:10.035778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:10.036061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:10.038041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:10.073649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 993/1986] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:10 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:10.078699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:10.091307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b7d5-f5e6-4897-910a-a42c26dd6107 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:10.200201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:10.201017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:10.201587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:10.201985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:10.202826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:10.204983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:10.245187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 994/1987] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:10 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:10.249092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:10.268054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87426bf-b855-4f5e-9bfc-fa35a3acf596 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:10.274068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:10.275076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:10.275509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:10.275880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:10.276724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:10.282718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:10.301656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 994/1988] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:10.306208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:10.320440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe8bbc-48b4-4682-a9ec-2e33e2fb4d8b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:10.327342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b09f54-ef8c-4a6e-a688-a2eb0bc35c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:10.327986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b09f54-ef8c-4a6e-a688-a2eb0bc35c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:10.328270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b09f54-ef8c-4a6e-a688-a2eb0bc35c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:10.328594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b09f54-ef8c-4a6e-a688-a2eb0bc35c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:10.329337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b09f54-ef8c-4a6e-a688-a2eb0bc35c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:10.331046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b09f54-ef8c-4a6e-a688-a2eb0bc35c92 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:10.344578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 995/1989] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:10.348599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:10.360463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943610e-1109-4d87-8bc6-1a5e8fe621d6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:10.366360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:10.367190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:10.367349 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:10.367624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] PATH_INFO: `/v3/projects/ed27276d0d8246f1920bbe58cbe818b3/users/f64acf13e31c4d97a130c1c26345b285/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:10.384333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed27276d0d8246f1920bbe58cbe818b3, user_id=f64acf13e31c4d97a130c1c26345b285, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:10.387011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:10.405316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 995/1990] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:10 2022] PUT /identity/v3/projects/ed27276d0d8246f1920bbe58cbe818b3/users/f64acf13e31c4d97a130c1c26345b285/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:10.420123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939c1d-179a-40be-b25c-e250e6165fd5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:10.421610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939c1d-179a-40be-b25c-e250e6165fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:10.421911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939c1d-179a-40be-b25c-e250e6165fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:10.494557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-83939c1d-179a-40be-b25c-e250e6165fd5 None None] MFA Rules not processed for user `f64acf13e31c4d97a130c1c26345b285`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:10.496348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83939c1d-179a-40be-b25c-e250e6165fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:10.502445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:10.638415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 996/1991] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:10.643022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:10.661212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:10.753523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86419c-e824-4493-8b10-6c5ae3034549 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:10.778653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:10.780245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:10.780541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:10.780812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:10.783999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:10.789563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:10.876377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83939c1d-179a-40be-b25c-e250e6165fd5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:10.877430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 996/1992] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:10 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:10.893441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83939c1d-179a-40be-b25c-e250e6165fd5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.040833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.041684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.041933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.042083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.042748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.045195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.104089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 997/1993] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:10 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:11.111745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.128306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d11a-23a6-40b1-b0b3-537786dd5138 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.133898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.134812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.135297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.135841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.137073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.138794 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.157792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.165521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 997/1994] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:11.176339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963102-6e88-40a9-b865-04cc1fd4de69 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.181416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.182222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.182506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.182850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] PATH_INFO: `/v3/projects/3358676fcc19443ab75cb8e251cfdb27/users/ec4e5d4385b14a288368771f08d20d25/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.208046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3358676fcc19443ab75cb8e251cfdb27, user_id=ec4e5d4385b14a288368771f08d20d25, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.212108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.228274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 998/1995] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:11 2022] PUT /identity/v3/projects/3358676fcc19443ab75cb8e251cfdb27/users/ec4e5d4385b14a288368771f08d20d25/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:11.232345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.246644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a3b32-b70c-42f1-9b39-44d5b6a21b36 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.311796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba79cd-8461-4851-abf1-989be0cbea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.312465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba79cd-8461-4851-abf1-989be0cbea3b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.312750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba79cd-8461-4851-abf1-989be0cbea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.313028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba79cd-8461-4851-abf1-989be0cbea3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.313832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba79cd-8461-4851-abf1-989be0cbea3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.315818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba79cd-8461-4851-abf1-989be0cbea3b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.325841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 998/1996] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:11.330014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.340871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d597b-9c27-456e-ba37-4b9206652e8e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.345860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.346550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.346837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.347118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] PATH_INFO: `/v3/projects/3358676fcc19443ab75cb8e251cfdb27/users/ec4e5d4385b14a288368771f08d20d25/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.349414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3358676fcc19443ab75cb8e251cfdb27, user_id=ec4e5d4385b14a288368771f08d20d25, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.352196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.362741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 999/1997] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:11 2022] PUT /identity/v3/projects/3358676fcc19443ab75cb8e251cfdb27/users/ec4e5d4385b14a288368771f08d20d25/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:11.373801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f215-7119-4f4a-98de-840e102b9331 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.374071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f215-7119-4f4a-98de-840e102b9331 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.374350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f215-7119-4f4a-98de-840e102b9331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.408167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ee08f215-7119-4f4a-98de-840e102b9331 None None] MFA Rules not processed for user `ec4e5d4385b14a288368771f08d20d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:11.409552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ee08f215-7119-4f4a-98de-840e102b9331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:11.487398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 999/1998] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:11.498446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.500272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:11.573150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b04cb1-373c-4f58-aa4a-e8885d085632 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.577441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.578077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.578354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.579212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.591467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.593258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.600781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:11.610913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1000/1999] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:11.645096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08f215-7119-4f4a-98de-840e102b9331 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.656546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:11.727913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08f215-7119-4f4a-98de-840e102b9331 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.732723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.733514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.733692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.733978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] PATH_INFO: `/v3/users/f64acf13e31c4d97a130c1c26345b285` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.735201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64acf13e31c4d97a130c1c26345b285)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.737236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.746275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.747811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:11.761733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf21d2-97c9-4c49-97cd-7da0af4b95ab service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:11.766516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:11.767222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.767543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.767828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] PATH_INFO: `/v3/users/b4609a19bb8a4bd0aacf6af1740f4e81` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.769114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4609a19bb8a4bd0aacf6af1740f4e81)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:11.771116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:11.789979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64acf13e31c4d97a130c1c26345b285'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.798344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64acf13e31c4d97a130c1c26345b285'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.812560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64acf13e31c4d97a130c1c26345b285'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.821740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64acf13e31c4d97a130c1c26345b285'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.822745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90a84694-dd37-48c9-991e-5acb239fcffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64acf13e31c4d97a130c1c26345b285'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.829681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4609a19bb8a4bd0aacf6af1740f4e81'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.830288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1000/2000] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:11 2022] DELETE /identity/v3/users/f64acf13e31c4d97a130c1c26345b285 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:11.834889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.835174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.835453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.840429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4609a19bb8a4bd0aacf6af1740f4e81'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.848897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4609a19bb8a4bd0aacf6af1740f4e81'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.855047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:11.856288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:11.864049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4609a19bb8a4bd0aacf6af1740f4e81'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.864750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b905e199-d8f4-49cb-a39b-0024edf2f56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4609a19bb8a4bd0aacf6af1740f4e81'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:11.870721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1001/2001] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:11 2022] DELETE /identity/v3/users/b4609a19bb8a4bd0aacf6af1740f4e81 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:11.875300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:11.875582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:11.875917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:11.895189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:11.896451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:11.919610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1001/2002] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:11.929360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.930958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:11.957424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1002/2003] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:11.965669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:11.970616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:11.973242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:11.997718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c0022-d757-4e05-bda4-7fdd06c19ba6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:12.050009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:12.050945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:12.051405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:12.051515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d675eb3-8acd-461c-869f-af816543ca82 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:12.051860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:12.056159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:12.056784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:12.057065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:12.057381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:12.064512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:12.066464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:12.069040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:12.070841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:12.079633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1002/2004] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:12.087368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1003/2005] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:12.547962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:12.549674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:12.565864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862c65-cbfd-4462-85a6-e3dbda987bcc service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:12.571055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:12.572107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:12.572408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:12.572974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] PATH_INFO: `/v3/users/ef09084b08124412a13fe6ac9403a09b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:12.573926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef09084b08124412a13fe6ac9403a09b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:12.575946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:12.638383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef09084b08124412a13fe6ac9403a09b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.650064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef09084b08124412a13fe6ac9403a09b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.656389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:12.658042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:12.672132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef09084b08124412a13fe6ac9403a09b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.680282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef09084b08124412a13fe6ac9403a09b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.681428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4808adb7-dc2e-467a-b0f3-74adacd01215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef09084b08124412a13fe6ac9403a09b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.687160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642dee-6a28-456c-903a-d3457c76c84e service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:12.696724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1003/2006] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:12 2022] DELETE /identity/v3/users/ef09084b08124412a13fe6ac9403a09b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:12.697138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:12.697983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:12.698162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:12.698262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:12.698430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:12.698584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] PATH_INFO: `/v3/projects/ed27276d0d8246f1920bbe58cbe818b3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:12.698690 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:12.700255 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed27276d0d8246f1920bbe58cbe818b3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:12.703176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:12.718654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:12.724389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:12.725656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:12.796375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:12.803977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed27276d0d8246f1920bbe58cbe818b3', 'request_id': 'req-cc58e8e3-4214-4da9-aef6-a379cdd89427'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.816446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1004/2007] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:12.817492 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:12.818246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed27276d0d8246f1920bbe58cbe818b3', 'request_id': 'req-cc58e8e3-4214-4da9-aef6-a379cdd89427'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.822488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:12.830375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed27276d0d8246f1920bbe58cbe818b3', 'request_id': 'req-cc58e8e3-4214-4da9-aef6-a379cdd89427'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.847793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f058-a7c8-4d01-93b6-dc4f92bafb2d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:12.857002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] The token cache is being invalidate because project ed27276d0d8246f1920bbe58cbe818b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:12.857336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.861485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.863586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1004/2008] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:12 2022] DELETE /identity/v3/projects/ed27276d0d8246f1920bbe58cbe818b3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:12.866344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:12.870100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:12.931367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:12.931968 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:12.932318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:12.932604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] PATH_INFO: `/v3/projects/f46dbaa53abe4a97a661415eb8b3c362` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:12.933868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46dbaa53abe4a97a661415eb8b3c362)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:12.935832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:12.946807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e8e3-4214-4da9-aef6-a379cdd89427 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:12.950522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:12.951147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:12.951434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:12.951708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:12.953631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:12.966518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:12.968757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:12.979564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1005/2009] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:12.980414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:12.981770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:12.991846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46dbaa53abe4a97a661415eb8b3c362', 'request_id': 'req-a74b7fa3-f472-479e-a1b7-74184bcc2e34'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:12.994149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbebc4-5c62-4520-82f3-61955a58066e service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:12.998319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46dbaa53abe4a97a661415eb8b3c362', 'request_id': 'req-a74b7fa3-f472-479e-a1b7-74184bcc2e34'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.007802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46dbaa53abe4a97a661415eb8b3c362', 'request_id': 'req-a74b7fa3-f472-479e-a1b7-74184bcc2e34'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.029359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] The token cache is being invalidate because project f46dbaa53abe4a97a661415eb8b3c362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:13.029671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.030662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.037167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1005/2010] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:12 2022] DELETE /identity/v3/projects/f46dbaa53abe4a97a661415eb8b3c362 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:13.041937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:13.043772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:13.065748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:13.066678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:13.067141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:13.067673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] PATH_INFO: `/v3/users/ec4e5d4385b14a288368771f08d20d25` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:13.069257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4e5d4385b14a288368771f08d20d25)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:13.074507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:13.138819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:13.139193 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7fa3-f472-479e-a1b7-74184bcc2e34 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:13.142191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4e5d4385b14a288368771f08d20d25'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.145048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:13.145741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:13.146023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:13.146290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] PATH_INFO: `/v3/users/4e4fe7b6a7b64e6ebdb812d134702907` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:13.147619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4fe7b6a7b64e6ebdb812d134702907)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:13.149825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:13.153700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4e5d4385b14a288368771f08d20d25'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.170041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4e5d4385b14a288368771f08d20d25'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.187844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4e5d4385b14a288368771f08d20d25'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.188692 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4e5d4385b14a288368771f08d20d25'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.196162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1006/2011] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:12 2022] DELETE /identity/v3/users/ec4e5d4385b14a288368771f08d20d25 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:13.205522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:13.224188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4fe7b6a7b64e6ebdb812d134702907'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.238397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4fe7b6a7b64e6ebdb812d134702907'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.256816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4fe7b6a7b64e6ebdb812d134702907'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.265611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4fe7b6a7b64e6ebdb812d134702907'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.272317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4fe7b6a7b64e6ebdb812d134702907'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.281486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1006/2012] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:13 2022] DELETE /identity/v3/users/4e4fe7b6a7b64e6ebdb812d134702907 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:13.330487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:13.332764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:13.425350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfaf57-1a9b-47d8-830d-9af64154cbbb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:13.516929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:13.518026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:13.518400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:13.518772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] PATH_INFO: `/v3/projects/e37b1c994aa8478397ca00b7c53d577a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:13.520367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37b1c994aa8478397ca00b7c53d577a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:13.523442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:13.618106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37b1c994aa8478397ca00b7c53d577a', 'request_id': 'req-c6c581cd-ecc1-4721-b83f-9c115144769f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.639207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37b1c994aa8478397ca00b7c53d577a', 'request_id': 'req-c6c581cd-ecc1-4721-b83f-9c115144769f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.651495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37b1c994aa8478397ca00b7c53d577a', 'request_id': 'req-c6c581cd-ecc1-4721-b83f-9c115144769f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.667334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:13.681801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] The token cache is being invalidate because project e37b1c994aa8478397ca00b7c53d577a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:13.682279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.683823 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.685549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1007/2013] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:13 2022] DELETE /identity/v3/projects/e37b1c994aa8478397ca00b7c53d577a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:13.689651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:13.692200 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:13.707404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f7b67-4f28-4161-ad42-e816617e6b95 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:13.734634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:13.736378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:13.873386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:13.874441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:13.875115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:13.875407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] PATH_INFO: `/v3/users/7295c319f3c64fec9592e7f6fe255150` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:13.876812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7295c319f3c64fec9592e7f6fe255150)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:13.878892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:13.923565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581cd-ecc1-4721-b83f-9c115144769f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:13.946066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:13.946750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:13.947041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:13.947316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] PATH_INFO: `/v3/projects/3358676fcc19443ab75cb8e251cfdb27` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:13.955531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3358676fcc19443ab75cb8e251cfdb27)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:13.958029 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:13.958265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7295c319f3c64fec9592e7f6fe255150'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:13.977549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7295c319f3c64fec9592e7f6fe255150'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.001637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7295c319f3c64fec9592e7f6fe255150'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.034380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7295c319f3c64fec9592e7f6fe255150'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.035528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7295c319f3c64fec9592e7f6fe255150'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.038118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3358676fcc19443ab75cb8e251cfdb27', 'request_id': 'req-806c5f5f-de71-4c97-be1d-0bec31560358'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.049320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3358676fcc19443ab75cb8e251cfdb27', 'request_id': 'req-806c5f5f-de71-4c97-be1d-0bec31560358'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.054796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1007/2014] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:13 2022] DELETE /identity/v3/users/7295c319f3c64fec9592e7f6fe255150 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:14.055672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.062371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:14.068601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3358676fcc19443ab75cb8e251cfdb27', 'request_id': 'req-806c5f5f-de71-4c97-be1d-0bec31560358'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.144272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] The token cache is being invalidate because project 3358676fcc19443ab75cb8e251cfdb27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:14.144930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.148030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-806c5f5f-de71-4c97-be1d-0bec31560358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.159224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1008/2015] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:13 2022] DELETE /identity/v3/projects/3358676fcc19443ab75cb8e251cfdb27 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:14.161511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cdde7-c64e-4e52-9295-49cfb834d0d2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.161924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cdde7-c64e-4e52-9295-49cfb834d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.162400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cdde7-c64e-4e52-9295-49cfb834d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.195203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:14.225984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-515cdde7-c64e-4e52-9295-49cfb834d0d2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:14.227258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-515cdde7-c64e-4e52-9295-49cfb834d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:14.261707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe68a6b-d9c0-4149-ae3e-a73a14c33314 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.277923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:14.278981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.279451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.279931 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] PATH_INFO: `/v3/projects/4406fdc6076149ddac62f856d74446f2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.284328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4406fdc6076149ddac62f856d74446f2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:14.286559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:14.318004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1009/2016] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:14.326298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbaa2b-6574-4097-b4ec-7f98e88f047f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.326944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbaa2b-6574-4097-b4ec-7f98e88f047f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.327222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbaa2b-6574-4097-b4ec-7f98e88f047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.351662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-08bbaa2b-6574-4097-b4ec-7f98e88f047f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:14.353037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-08bbaa2b-6574-4097-b4ec-7f98e88f047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:14.376382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4406fdc6076149ddac62f856d74446f2', 'request_id': 'req-6ad4a862-3e38-407b-850a-50f85cd0f282'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.381910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:14.383774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4406fdc6076149ddac62f856d74446f2', 'request_id': 'req-6ad4a862-3e38-407b-850a-50f85cd0f282'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.398919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4406fdc6076149ddac62f856d74446f2', 'request_id': 'req-6ad4a862-3e38-407b-850a-50f85cd0f282'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.419538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] The token cache is being invalidate because project 4406fdc6076149ddac62f856d74446f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:14.419923 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.420868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6ad4a862-3e38-407b-850a-50f85cd0f282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.423265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1008/2017] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:14 2022] DELETE /identity/v3/projects/4406fdc6076149ddac62f856d74446f2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:14.428784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da379e23-b748-4a0f-94f8-09c3a798fd62 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.429426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da379e23-b748-4a0f-94f8-09c3a798fd62 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.429426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da379e23-b748-4a0f-94f8-09c3a798fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.435578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1010/2018] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:14.439511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbaa2b-6574-4097-b4ec-7f98e88f047f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.450593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbaa2b-6574-4097-b4ec-7f98e88f047f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.453838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-da379e23-b748-4a0f-94f8-09c3a798fd62 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:14.455137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-da379e23-b748-4a0f-94f8-09c3a798fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:14.456245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:14.457507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.457930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.458345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.459532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:14.459981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:14.462061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:14.471634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1009/2019] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:14.473451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e536f5-3d32-4840-9e2c-4bdeef80e382 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.473886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e536f5-3d32-4840-9e2c-4bdeef80e382 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.474442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e536f5-3d32-4840-9e2c-4bdeef80e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.482321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1011/2020] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:33:14.486729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.498093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4344482-6f78-447f-860c-d0939ac9b7d9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.499115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-25e536f5-3d32-4840-9e2c-4bdeef80e382 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:14.500450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25e536f5-3d32-4840-9e2c-4bdeef80e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:14.506010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:14.506390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.507042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.507042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.509738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:14.510003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:14.512470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1010/2021] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:14.516954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e536f5-3d32-4840-9e2c-4bdeef80e382 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.530172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e536f5-3d32-4840-9e2c-4bdeef80e382 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.550125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:14.551327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.551812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.552390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.553697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:14.554068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:14.556360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:14.556503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1012/2022] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:14.560492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.562593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:14.583699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1011/2023] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:14.583699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.598156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f1811-c817-4ab9-aa2c-b7bedc786517 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.646574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd6d74-f74b-4d18-8080-58ced02be4f0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.651981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:14.652734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.653016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.653310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] PATH_INFO: `/v3/projects/c8bf7cbfe30740a6ade559e9ac04f107` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.654743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bf7cbfe30740a6ade559e9ac04f107)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:14.657023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:14.684033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:14.684947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.685475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.686178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.687065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:14.689833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:14.733190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1012/2024] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:14.734308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.749185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd59e4-518f-491d-bb2e-b19abcc64a02 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.758703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bf7cbfe30740a6ade559e9ac04f107', 'request_id': 'req-ca911f80-c2d4-41e1-8e65-92f7e32c0668'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.777131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:14.786457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bf7cbfe30740a6ade559e9ac04f107', 'request_id': 'req-ca911f80-c2d4-41e1-8e65-92f7e32c0668'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.798916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bf7cbfe30740a6ade559e9ac04f107', 'request_id': 'req-ca911f80-c2d4-41e1-8e65-92f7e32c0668'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.815581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] The token cache is being invalidate because project c8bf7cbfe30740a6ade559e9ac04f107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:14.816022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.816800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:14.818773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1013/2025] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:14 2022] DELETE /identity/v3/projects/c8bf7cbfe30740a6ade559e9ac04f107 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:14.819596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:14.821031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:14.841466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6a72-cc89-4809-99ec-ec8ea5584a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:14.842780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6a72-cc89-4809-99ec-ec8ea5584a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.843475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6a72-cc89-4809-99ec-ec8ea5584a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.843847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6a72-cc89-4809-99ec-ec8ea5584a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.844693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f6a72-cc89-4809-99ec-ec8ea5584a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:14.848257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f6a72-cc89-4809-99ec-ec8ea5584a6e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:14.866634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:14.909845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1013/2026] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:14.911137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:14.911434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:14.911715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:14.939487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca911f80-c2d4-41e1-8e65-92f7e32c0668 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:14.939688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:14.940877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:15.057255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1014/2027] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:15.058352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.065717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:15.079317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52864365-393d-4303-99ca-23d7c6e9ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.080019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52864365-393d-4303-99ca-23d7c6e9ba25 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.080314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52864365-393d-4303-99ca-23d7c6e9ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.080590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52864365-393d-4303-99ca-23d7c6e9ba25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.085846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52864365-393d-4303-99ca-23d7c6e9ba25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.087731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52864365-393d-4303-99ca-23d7c6e9ba25 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.096879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1aafa-2e76-4456-889e-e7cdd4b37cad None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.100133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1014/2028] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:15.104935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a154-cacc-461a-824f-def5fb05a281 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.105380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a154-cacc-461a-824f-def5fb05a281 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.105842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a154-cacc-461a-824f-def5fb05a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.119577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.120524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.120942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.121470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.122261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.133011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.159767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3947a154-cacc-461a-824f-def5fb05a281 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:15.160995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3947a154-cacc-461a-824f-def5fb05a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:15.174013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1015/2029] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:15.175004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947a154-cacc-461a-824f-def5fb05a281 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.181873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1015/2030] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:15 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:15.183236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.196239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947a154-cacc-461a-824f-def5fb05a281 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.213778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.214531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.214907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.215401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.216029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedee68-abb9-4dfc-898d-ad7b64e19300 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.216372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.221783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.229223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.229922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.230198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.230478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.233783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:15.233920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.239203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.245703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1016/2031] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:15.246713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.267136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5bfd-f8f4-43e2-b79e-c21dd94a3f25 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.273138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.273935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.274318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.274688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.275508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.277882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.286132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1016/2032] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:15.288356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.294118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1017/2033] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:15.295023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.321178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8c076-c084-47b7-9339-db96c99d74c6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.321634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8556b9-ac4d-4ebd-b6ab-2b551d97804d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.327935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.328769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.329337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.329795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.330779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.333265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.333803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.334137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.334434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.334719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] PATH_INFO: `/v3/projects/4b0b93f5e70f4a2594ab6ac6f3e4527c/users/3a893bdd4583472e96dbeec186542061/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.354157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0b93f5e70f4a2594ab6ac6f3e4527c, user_id=3a893bdd4583472e96dbeec186542061, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.357500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.376458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1018/2034] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:15 2022] POST /identity/v3/projects => generated 361 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:15.376458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.383370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1017/2035] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:15 2022] PUT /identity/v3/projects/4b0b93f5e70f4a2594ab6ac6f3e4527c/users/3a893bdd4583472e96dbeec186542061/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:15.386086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.507523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60598567-18fb-43ee-b6a9-aafa1ef7bc9a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.515288 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c193fd-02bb-48d4-a393-772ce720cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.516448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c193fd-02bb-48d4-a393-772ce720cb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.516887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c193fd-02bb-48d4-a393-772ce720cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.517536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c193fd-02bb-48d4-a393-772ce720cb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.519737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c193fd-02bb-48d4-a393-772ce720cb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.522300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c193fd-02bb-48d4-a393-772ce720cb87 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.537561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:15.557130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7c93-ffdf-4be9-9604-eee60eb9e400 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.558407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1019/2036] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:15.560635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69b51-da8a-4b3e-9115-13acfdb6babb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.560913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69b51-da8a-4b3e-9115-13acfdb6babb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.561479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69b51-da8a-4b3e-9115-13acfdb6babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.571346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.572003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.572291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.573331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.573331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.577755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.625701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-07e69b51-da8a-4b3e-9115-13acfdb6babb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:15.627348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-07e69b51-da8a-4b3e-9115-13acfdb6babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:15.634233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1018/2037] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:15 2022] POST /identity/v3/users => generated 281 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:15.635111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.652538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1020/2038] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:15.653441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e69b51-da8a-4b3e-9115-13acfdb6babb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.664392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e69b51-da8a-4b3e-9115-13acfdb6babb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.669995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f2f50-df4c-46f2-a184-c29d51d8cfbf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.672452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.673261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.673673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.674054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.674869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.676533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.676785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.677458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.678574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:15.685856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.685856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] PATH_INFO: `/v3/projects/a9ab939ef0db410e95e4e185216456f0/users/404ae53b767d455faa98328cec856929/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.693695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1021/2039] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:15.693695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.703496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:15.713969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ab939ef0db410e95e4e185216456f0, user_id=404ae53b767d455faa98328cec856929, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.721015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.742588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1019/2040] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:15 2022] PUT /identity/v3/projects/a9ab939ef0db410e95e4e185216456f0/users/404ae53b767d455faa98328cec856929/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:15.743276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:15.893495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec21dec-55b3-4ee1-a145-049a3c9b6318 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.907449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd90ba-1b51-4fe2-a065-b0e791b67411 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:15.920533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ab4e-8fc4-40e4-8c1a-022c020fdee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.921210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ab4e-8fc4-40e4-8c1a-022c020fdee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.921566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ab4e-8fc4-40e4-8c1a-022c020fdee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.921886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ab4e-8fc4-40e4-8c1a-022c020fdee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.922603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9ab4e-8fc4-40e4-8c1a-022c020fdee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.924471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9ab4e-8fc4-40e4-8c1a-022c020fdee1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:15.938392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1020/2041] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:15.943630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd11e78-6b2e-4169-b799-814f246a7618 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.943960 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd11e78-6b2e-4169-b799-814f246a7618 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.944414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd11e78-6b2e-4169-b799-814f246a7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.974998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:15.975785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:15.976163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:15.976576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:15.981504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6bd11e78-6b2e-4169-b799-814f246a7618 None None] MFA Rules not processed for user `404ae53b767d455faa98328cec856929`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:15.983022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6bd11e78-6b2e-4169-b799-814f246a7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:15.994189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:15.996807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.013761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1022/2042] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:16.022733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.046962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178496b-b099-48c8-ac2a-263b0e43acfb service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.072707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ee85e-7c40-42d7-9671-4133f67e28ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.073446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ee85e-7c40-42d7-9671-4133f67e28ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.073795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ee85e-7c40-42d7-9671-4133f67e28ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.074394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ee85e-7c40-42d7-9671-4133f67e28ba admin admin] PATH_INFO: `/v3/projects/601c92d3608f4188b602bb4f971e9666/users/467596801d7744dd865d0aab1a3cfcb0/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.094111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ee85e-7c40-42d7-9671-4133f67e28ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=601c92d3608f4188b602bb4f971e9666, user_id=467596801d7744dd865d0aab1a3cfcb0, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.096994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ee85e-7c40-42d7-9671-4133f67e28ba admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.104102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1021/2043] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:16.107752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd11e78-6b2e-4169-b799-814f246a7618 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.124598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1023/2044] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:16 2022] PUT /identity/v3/projects/601c92d3608f4188b602bb4f971e9666/users/467596801d7744dd865d0aab1a3cfcb0/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:16.131188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd11e78-6b2e-4169-b799-814f246a7618 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.136962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4eec-beed-49b3-91e9-50b630473e71 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.137413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4eec-beed-49b3-91e9-50b630473e71 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.137641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4eec-beed-49b3-91e9-50b630473e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.178159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-51be4eec-beed-49b3-91e9-50b630473e71 None None] MFA Rules not processed for user `467596801d7744dd865d0aab1a3cfcb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:16.179571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-51be4eec-beed-49b3-91e9-50b630473e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:16.235449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:16.280743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.281454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.281746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.281993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.282681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.291539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.327084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1024/2045] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:16.339812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1022/2046] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:16 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:16.343719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4eec-beed-49b3-91e9-50b630473e71 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.362651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4eec-beed-49b3-91e9-50b630473e71 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.369734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.371718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:16.386258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:16.446503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.447199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.447488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.447765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.448444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.452030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.489883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1025/2047] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:16 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:16.494955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.511418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4290b-3c6f-45e3-969c-275809e5e79a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.512653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7057fe-3098-4558-9ab7-f96a672d71d9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.524877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.525396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.526397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.526397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.526397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.527399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.527972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.528389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.529557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.531681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.549804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1026/2048] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:16.551906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.567685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5988ef-1ffa-456d-b2a9-4fbd1fe7a7c5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.579442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.581099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.581593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.582566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.583502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.588389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.613995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1027/2049] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:16.618670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.634296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f856d65-966a-4f9b-a811-93a8f27a2031 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.634987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.636542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.639697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee0152-17b3-4fb0-89f4-e896a488a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.641147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee0152-17b3-4fb0-89f4-e896a488a3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.641496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee0152-17b3-4fb0-89f4-e896a488a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.642127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee0152-17b3-4fb0-89f4-e896a488a3e1 admin admin] PATH_INFO: `/v3/projects/afdff78b891b42819a052518bde04078/users/6e097622a9ce4031b7322b963e9f35de/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.647197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1023/2050] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:16.668678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee0152-17b3-4fb0-89f4-e896a488a3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdff78b891b42819a052518bde04078, user_id=6e097622a9ce4031b7322b963e9f35de, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.673079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.675138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee0152-17b3-4fb0-89f4-e896a488a3e1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.695843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1028/2051] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:16 2022] PUT /identity/v3/projects/afdff78b891b42819a052518bde04078/users/6e097622a9ce4031b7322b963e9f35de/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:16.699817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61279edc-76e9-4958-ab8e-2280c318082b service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.707489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772eb5-0829-4dd6-9d20-4f56b3cafc72 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.707779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772eb5-0829-4dd6-9d20-4f56b3cafc72 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.708055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772eb5-0829-4dd6-9d20-4f56b3cafc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.742627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-41772eb5-0829-4dd6-9d20-4f56b3cafc72 None None] MFA Rules not processed for user `6e097622a9ce4031b7322b963e9f35de`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:16.743970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-41772eb5-0829-4dd6-9d20-4f56b3cafc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:16.782628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.784830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.785634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.786013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] PATH_INFO: `/v3/users/467596801d7744dd865d0aab1a3cfcb0` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.787524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=467596801d7744dd865d0aab1a3cfcb0)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.789798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.833511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:16.835688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1029/2052] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:16.841211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772eb5-0829-4dd6-9d20-4f56b3cafc72 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.866499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772eb5-0829-4dd6-9d20-4f56b3cafc72 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:16.890316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:16.891022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.891299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.891572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:16.892377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:16.894341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:16.913813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467596801d7744dd865d0aab1a3cfcb0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:16.930070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467596801d7744dd865d0aab1a3cfcb0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:16.937077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1030/2053] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:16 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:16.940669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:16.968952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467596801d7744dd865d0aab1a3cfcb0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:16.977381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467596801d7744dd865d0aab1a3cfcb0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:16.978280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25726790-3a00-440b-8b15-45a893103e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467596801d7744dd865d0aab1a3cfcb0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:16.984884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1024/2054] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:16 2022] DELETE /identity/v3/users/467596801d7744dd865d0aab1a3cfcb0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:16.986461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86eed-e296-46d7-971a-ea617a5c0fce None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:16.986669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86eed-e296-46d7-971a-ea617a5c0fce None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:16.986950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86eed-e296-46d7-971a-ea617a5c0fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.022145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1df86eed-e296-46d7-971a-ea617a5c0fce None None] MFA Rules not processed for user `3a893bdd4583472e96dbeec186542061`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:17.023366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1df86eed-e296-46d7-971a-ea617a5c0fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:17.026245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:17.072672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8c7fe-e2ca-493a-bdc8-607072a4bbf1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:17.215479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1025/2055] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:17.218268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.223061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:17.223603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.230086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.230244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.230350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.230443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.231002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:17.232967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:17.283918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:17.286984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:17.287113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1031/2056] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:16 2022] POST /identity/v3/users => generated 296 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:17.287948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:17.297327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:17.317848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1026/2057] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:17.320420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:17.324515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:17.342581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e88e28-7a7e-462e-9749-b69e523e0f2e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:17.348669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:17.349336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.349959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.349959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.351136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:17.352999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:17.367220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1027/2058] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:17.368189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:17.373240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:17.406976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76833-b6ff-4b3d-a481-a98747ae5018 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:17.412638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:17.413927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.414383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.414670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.429784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:17.431291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:17.441325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1032/2059] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:17.442225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:17.453783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7b75-42e1-49e2-a7b4-820ce10bf945 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:17.459180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:17.459859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.460137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.460412 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] PATH_INFO: `/v3/projects/e02a678799f14bc8a7c9aa4aa8658227/users/1784bd4862b44d43aeba04a8f8c6bf45/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.478851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02a678799f14bc8a7c9aa4aa8658227, user_id=1784bd4862b44d43aeba04a8f8c6bf45, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:17.481570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:17.506548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1033/2060] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:17 2022] PUT /identity/v3/projects/e02a678799f14bc8a7c9aa4aa8658227/users/1784bd4862b44d43aeba04a8f8c6bf45/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:17.508088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:17.541336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597f02e-97dc-4656-8732-e5d80a98214f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:17.582248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:17.629492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90adc6-33ec-4164-bb5b-552f4f72b1f8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:17.643201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:17.646611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:17.647369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.648253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.648935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.651670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:17.661483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:17.695550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c741f-862a-45bb-8eb7-4d11e6821775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:17.698222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c741f-862a-45bb-8eb7-4d11e6821775 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.699512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c741f-862a-45bb-8eb7-4d11e6821775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.699941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c741f-862a-45bb-8eb7-4d11e6821775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.704357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1034/2061] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:17.708996 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:17.724256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c741f-862a-45bb-8eb7-4d11e6821775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:17.726730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c741f-862a-45bb-8eb7-4d11e6821775 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:17.733529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0ada-ca3c-47ce-9625-a4b031872828 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:17.750617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:17.752666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.752666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.752666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] PATH_INFO: `/v3/projects/e02a678799f14bc8a7c9aa4aa8658227/users/1784bd4862b44d43aeba04a8f8c6bf45/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.753746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1028/2062] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:17.763044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02a678799f14bc8a7c9aa4aa8658227, user_id=1784bd4862b44d43aeba04a8f8c6bf45, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:17.766881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:17.780490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1035/2063] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:17 2022] PUT /identity/v3/projects/e02a678799f14bc8a7c9aa4aa8658227/users/1784bd4862b44d43aeba04a8f8c6bf45/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:17.793368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70463b4-bf38-4009-832c-0214804f98ee None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:17.793917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70463b4-bf38-4009-832c-0214804f98ee None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:17.794188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70463b4-bf38-4009-832c-0214804f98ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:17.834879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c70463b4-bf38-4009-832c-0214804f98ee None None] MFA Rules not processed for user `1784bd4862b44d43aeba04a8f8c6bf45`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:17.836443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c70463b4-bf38-4009-832c-0214804f98ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:17.946882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1029/2064] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:17.959459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:17.961501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:18.088907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2442d3-80cc-4a89-8028-6f67cc1a008d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:18.100020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:18.100926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:18.100926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:18.101136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:18.118407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:18.136113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:18.153089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1036/2065] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:18.213325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70463b4-bf38-4009-832c-0214804f98ee None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:18.228271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70463b4-bf38-4009-832c-0214804f98ee None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:18.236092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819978f-95ed-4f89-b467-85cdc6116369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:18.237124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819978f-95ed-4f89-b467-85cdc6116369 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:18.237669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819978f-95ed-4f89-b467-85cdc6116369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:18.238420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819978f-95ed-4f89-b467-85cdc6116369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:18.240868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2819978f-95ed-4f89-b467-85cdc6116369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:18.310088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819978f-95ed-4f89-b467-85cdc6116369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:18.311571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819978f-95ed-4f89-b467-85cdc6116369 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:18.334809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1030/2066] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:18.560013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:18.562306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:18.677452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dabc9-8f73-4511-bd20-8fa52962704f service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:18.682612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:18.683706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:18.684075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:18.684398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] PATH_INFO: `/v3/projects/601c92d3608f4188b602bb4f971e9666` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:18.686031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=601c92d3608f4188b602bb4f971e9666)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:18.688157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:18.759546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601c92d3608f4188b602bb4f971e9666', 'request_id': 'req-d441d5fc-0065-4e54-abec-b3813e2588d9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:18.772695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601c92d3608f4188b602bb4f971e9666', 'request_id': 'req-d441d5fc-0065-4e54-abec-b3813e2588d9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:18.797631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601c92d3608f4188b602bb4f971e9666', 'request_id': 'req-d441d5fc-0065-4e54-abec-b3813e2588d9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:18.819836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] The token cache is being invalidate because project 601c92d3608f4188b602bb4f971e9666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:18.820191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:18.820785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d441d5fc-0065-4e54-abec-b3813e2588d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:18.827843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1037/2067] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:18 2022] DELETE /identity/v3/projects/601c92d3608f4188b602bb4f971e9666 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:18.829713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6647e-88b7-4b6c-9e45-e7e6b7ecb103 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:18.830786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6647e-88b7-4b6c-9e45-e7e6b7ecb103 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:18.831223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6647e-88b7-4b6c-9e45-e7e6b7ecb103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:18.886513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-69a6647e-88b7-4b6c-9e45-e7e6b7ecb103 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:18.892073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-69a6647e-88b7-4b6c-9e45-e7e6b7ecb103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:18.967577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:18.990552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3db1bd-8f22-4858-baf8-4567a7d353e1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:18.991206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3db1bd-8f22-4858-baf8-4567a7d353e1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:18.991206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3db1bd-8f22-4858-baf8-4567a7d353e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:18.999233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:18.999558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1031/2068] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:19.015299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4d3db1bd-8f22-4858-baf8-4567a7d353e1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:19.017323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4d3db1bd-8f22-4858-baf8-4567a7d353e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:19.026083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1038/2069] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:19.031051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6647e-88b7-4b6c-9e45-e7e6b7ecb103 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.044690 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6647e-88b7-4b6c-9e45-e7e6b7ecb103 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:19.050279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:19.050932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.051215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.052058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.052248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:19.052560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:19.054238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:19.069492 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1032/2070] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:33:19.072906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3db1bd-8f22-4858-baf8-4567a7d353e1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.088450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3db1bd-8f22-4858-baf8-4567a7d353e1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:19.094669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcce19-8e33-48c7-bd3b-158d8ab11b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:19.095785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcce19-8e33-48c7-bd3b-158d8ab11b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.096267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcce19-8e33-48c7-bd3b-158d8ab11b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.097011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcce19-8e33-48c7-bd3b-158d8ab11b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.097887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcce19-8e33-48c7-bd3b-158d8ab11b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:19.100257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcce19-8e33-48c7-bd3b-158d8ab11b90 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:19.142208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1039/2071] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:19 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:19.151995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.158358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723aec-fd0a-49ff-9a41-80b33256da7f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.158674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723aec-fd0a-49ff-9a41-80b33256da7f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.158962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723aec-fd0a-49ff-9a41-80b33256da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.172951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5adc5-0315-4e79-9178-911314d11611 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:19.179364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c9723aec-fd0a-49ff-9a41-80b33256da7f None None] MFA Rules not processed for user `3a893bdd4583472e96dbeec186542061`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:19.180694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c9723aec-fd0a-49ff-9a41-80b33256da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:19.260743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:19.261406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.261844 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1040/2072] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:19.261954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.261954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.262707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:19.264619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:19.295525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1033/2073] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:19 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:19.299118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9723aec-fd0a-49ff-9a41-80b33256da7f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.311857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9723aec-fd0a-49ff-9a41-80b33256da7f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:19.320186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:19.321074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.321652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.322130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.323142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:19.325146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:19.341343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1041/2074] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:19.343508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.355113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe32f-ed16-4d98-b2e0-90f3c1212130 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:19.361027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a450de-46e8-4957-9554-af158e8ee357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:19.361897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a450de-46e8-4957-9554-af158e8ee357 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.362421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a450de-46e8-4957-9554-af158e8ee357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.362873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a450de-46e8-4957-9554-af158e8ee357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.363755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a450de-46e8-4957-9554-af158e8ee357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:19.365571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a450de-46e8-4957-9554-af158e8ee357 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:19.380999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1034/2075] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:19.382530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.393173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc80b8-cd7a-4aa4-9023-e7d317cb3601 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:19.398624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:19.399738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.399738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.399909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] PATH_INFO: `/v3/projects/c618e372af7c46ed81ff3cdc5f15a39d/users/7c3f11da00f4429ab0e05b5a8f94ddac/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.415270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c618e372af7c46ed81ff3cdc5f15a39d, user_id=7c3f11da00f4429ab0e05b5a8f94ddac, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:19.418124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:19.435089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1042/2076] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:19 2022] PUT /identity/v3/projects/c618e372af7c46ed81ff3cdc5f15a39d/users/7c3f11da00f4429ab0e05b5a8f94ddac/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:19.445857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.446386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.446677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.477465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] MFA Rules not processed for user `7c3f11da00f4429ab0e05b5a8f94ddac`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:19.478721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:19.595860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1035/2077] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:19.606272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.608021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:19.676276 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530506e5-ca8a-463c-9a8e-0ed60ff38ca0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:19.680582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:19.681255 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:19.681633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:19.681976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:19.694314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:19.695916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:19.706699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1043/2078] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:19.987171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:19.989937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:20.186863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:20.211905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f1791-d91f-4111-ad53-25e61a88afb1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:20.232891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:20.233868 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:20.235032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:20.235683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] PATH_INFO: `/v3/users/d20a9348b61249308cfca0d45ce3efab` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:20.237390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20a9348b61249308cfca0d45ce3efab)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:20.239898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:20.312128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20a9348b61249308cfca0d45ce3efab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.326488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20a9348b61249308cfca0d45ce3efab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.343255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20a9348b61249308cfca0d45ce3efab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.356814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20a9348b61249308cfca0d45ce3efab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.357615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20a9348b61249308cfca0d45ce3efab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.366878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1036/2079] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:19 2022] DELETE /identity/v3/users/d20a9348b61249308cfca0d45ce3efab => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:20.576182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:20.597669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b87c-cf13-4c83-8002-9d34e6f5e107 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:20.664584 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:20.683229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:20.683980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:20.684334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:20.684718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] PATH_INFO: `/v3/projects/4349562653d744f0a6a5c6c11f2e20e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:20.686157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4349562653d744f0a6a5c6c11f2e20e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:20.688186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:20.746686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4349562653d744f0a6a5c6c11f2e20e5', 'request_id': 'req-f7ffaf87-49a1-405a-8462-8d163f0e5912'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.755997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4349562653d744f0a6a5c6c11f2e20e5', 'request_id': 'req-f7ffaf87-49a1-405a-8462-8d163f0e5912'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.763689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4349562653d744f0a6a5c6c11f2e20e5', 'request_id': 'req-f7ffaf87-49a1-405a-8462-8d163f0e5912'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.776528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] The token cache is being invalidate because project 4349562653d744f0a6a5c6c11f2e20e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:20.776834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.777592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.779135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1044/2080] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:20 2022] DELETE /identity/v3/projects/4349562653d744f0a6a5c6c11f2e20e5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:20.786222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:20.787678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:20.801559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed55f7-ae8e-4442-9920-3b66dcde87b6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:20.859918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:20.860599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:20.861036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:20.861408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] PATH_INFO: `/v3/users/b036a3a7fc044397a3160417f77bdf7c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:20.862591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b036a3a7fc044397a3160417f77bdf7c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:20.864542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:20.914782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b036a3a7fc044397a3160417f77bdf7c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.923603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b036a3a7fc044397a3160417f77bdf7c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.936588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b036a3a7fc044397a3160417f77bdf7c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.937801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:20.946297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b036a3a7fc044397a3160417f77bdf7c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.947347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7d5a5a0f-237c-4974-8907-92634e7112ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b036a3a7fc044397a3160417f77bdf7c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:20.953993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1037/2081] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:20 2022] DELETE /identity/v3/users/b036a3a7fc044397a3160417f77bdf7c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:21.157273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.161960 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:21.177670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffaf87-49a1-405a-8462-8d163f0e5912 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.258790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:21.260954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.262239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.262650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] PATH_INFO: `/v3/projects/35660580695c4591b4561d7ed8ebf9b2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.265617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=35660580695c4591b4561d7ed8ebf9b2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:21.268968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:21.338400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35660580695c4591b4561d7ed8ebf9b2', 'request_id': 'req-87a24537-b056-4467-a0eb-0757a262d5dc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:21.349173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35660580695c4591b4561d7ed8ebf9b2', 'request_id': 'req-87a24537-b056-4467-a0eb-0757a262d5dc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:21.357082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35660580695c4591b4561d7ed8ebf9b2', 'request_id': 'req-87a24537-b056-4467-a0eb-0757a262d5dc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:21.370018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] The token cache is being invalidate because project 35660580695c4591b4561d7ed8ebf9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:21.370315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:21.378037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87a24537-b056-4467-a0eb-0757a262d5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:21.379645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1045/2082] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:21 2022] DELETE /identity/v3/projects/35660580695c4591b4561d7ed8ebf9b2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:21.385568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795dcc5-52b2-4223-b89a-e5e761980da1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.386073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795dcc5-52b2-4223-b89a-e5e761980da1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.386160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795dcc5-52b2-4223-b89a-e5e761980da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.406625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0795dcc5-52b2-4223-b89a-e5e761980da1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:21.408317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0795dcc5-52b2-4223-b89a-e5e761980da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:21.468603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1038/2083] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:21.476454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13fd8-bbd4-478e-a796-a792ae9b55c0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.476770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13fd8-bbd4-478e-a796-a792ae9b55c0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.477049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13fd8-bbd4-478e-a796-a792ae9b55c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.492305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:21.498249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-25e13fd8-bbd4-478e-a796-a792ae9b55c0 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:21.500141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-25e13fd8-bbd4-478e-a796-a792ae9b55c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:21.509245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1046/2084] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:21.514204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795dcc5-52b2-4223-b89a-e5e761980da1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.524530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795dcc5-52b2-4223-b89a-e5e761980da1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.529511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:21.530124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.530404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.530672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.531373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:21.531738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:21.533492 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:21.545501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1039/2085] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:21.550008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13fd8-bbd4-478e-a796-a792ae9b55c0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.559274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13fd8-bbd4-478e-a796-a792ae9b55c0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.563955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:21.564566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.564841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.565110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.565810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:21.567708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:21.596728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1047/2086] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:21 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:21.601029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.611019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0cf2e-7b08-49b5-b0ee-7a8544f5a469 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.669866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:21.670755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.671056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.671415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.672377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:21.675499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:21.701840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1040/2087] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:21 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:21.706421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.717451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9c34-280a-4aad-b410-1219c662019f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.723198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:21.723847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.724129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.724433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.725849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:21.727687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:21.744098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1048/2088] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:21.746515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.762681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ee12-afab-41ac-b3f8-82fd0513ee1f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.770214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf9754-d808-4b6c-a684-1ae87a38c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:21.771088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9754-d808-4b6c-a684-1ae87a38c501 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.771443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9754-d808-4b6c-a684-1ae87a38c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.771788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9754-d808-4b6c-a684-1ae87a38c501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.772567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf9754-d808-4b6c-a684-1ae87a38c501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:21.775686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf9754-d808-4b6c-a684-1ae87a38c501 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:21.791713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1041/2089] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:21.795798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.806425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c481d1-fee6-476d-8308-942f7edb9d6d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.813659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:21.815059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.815059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.815241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] PATH_INFO: `/v3/projects/b9dd87f91da84733a55f7526f9c6b97c/users/b68c963132e94f65b7234ad8b5412e02/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.833681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9dd87f91da84733a55f7526f9c6b97c, user_id=b68c963132e94f65b7234ad8b5412e02, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:21.836645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:21.854762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1049/2090] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:21 2022] PUT /identity/v3/projects/b9dd87f91da84733a55f7526f9c6b97c/users/b68c963132e94f65b7234ad8b5412e02/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:21.865014 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3805222-217d-4eb6-812f-5f5335cf49e0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:21.865365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3805222-217d-4eb6-812f-5f5335cf49e0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:21.865603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3805222-217d-4eb6-812f-5f5335cf49e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:21.902770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:21.904768 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:21.909622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e3805222-217d-4eb6-812f-5f5335cf49e0 None None] MFA Rules not processed for user `b68c963132e94f65b7234ad8b5412e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:21.910852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e3805222-217d-4eb6-812f-5f5335cf49e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:21.969035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:21.994173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b62d-3e64-4fab-9168-7ee108b4ebf7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:21.999014 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1042/2091] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:22.000060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.000752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.001539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.002619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] PATH_INFO: `/v3/users/404ae53b767d455faa98328cec856929` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.003882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404ae53b767d455faa98328cec856929)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.006441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3805222-217d-4eb6-812f-5f5335cf49e0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.006621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.018797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3805222-217d-4eb6-812f-5f5335cf49e0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:22.026523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.027201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.028316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.028316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.028649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.030918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.060714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404ae53b767d455faa98328cec856929'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:22.063008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1043/2092] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:22 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:22.067143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.070788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404ae53b767d455faa98328cec856929'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:22.079892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404ae53b767d455faa98328cec856929'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:22.096711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404ae53b767d455faa98328cec856929'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:22.097507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28626fca-cab4-4892-bdda-46cacf0cc2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404ae53b767d455faa98328cec856929'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:22.106294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1050/2093] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:21 2022] DELETE /identity/v3/users/404ae53b767d455faa98328cec856929 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:22.111221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.111505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.111807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.132175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:22.133443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:22.137456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08cbe6-87b8-499c-a013-c888ce41acd1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:22.155052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:22.219780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1051/2094] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:22.243453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.245093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:22.252978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.253645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.253984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.254256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.255291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.257137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.284403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1044/2095] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:22 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:22.288709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.290430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:22.302941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb7aa-9655-4454-aa62-79ad573403e8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:22.308813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.309628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.309917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.310196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.311388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.313330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.334270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1045/2096] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:22.336657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.350505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1e32-ae80-4086-b3b2-daac2d04fbdf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:22.356645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32eb91-e2a8-4c00-a038-418c782af17d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:22.359970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb03623-aa34-42cb-8741-0813896e3d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.360766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb03623-aa34-42cb-8741-0813896e3d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.361051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb03623-aa34-42cb-8741-0813896e3d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.361356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb03623-aa34-42cb-8741-0813896e3d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.362935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.363835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.364125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.364575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.365175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.369084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.389251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1046/2097] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:22.389915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb03623-aa34-42cb-8741-0813896e3d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.390157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb03623-aa34-42cb-8741-0813896e3d6c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.416285 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1052/2098] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:22.420136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.453147 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d57b-9c6b-4f3a-8805-654949b4e06a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:22.467211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.467918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.468207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.468534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] PATH_INFO: `/v3/projects/59240b56187d4c3c8486e39a7b504a31/users/fd386a2f17364a108ed27fcb205a432c/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.507413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59240b56187d4c3c8486e39a7b504a31, user_id=fd386a2f17364a108ed27fcb205a432c, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.510131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.545067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1047/2099] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:22 2022] PUT /identity/v3/projects/59240b56187d4c3c8486e39a7b504a31/users/fd386a2f17364a108ed27fcb205a432c/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:22.557106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ca783-52ae-4174-a9d4-925b0f86c73c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.557437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ca783-52ae-4174-a9d4-925b0f86c73c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.557723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ca783-52ae-4174-a9d4-925b0f86c73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.614015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3d1ca783-52ae-4174-a9d4-925b0f86c73c None None] MFA Rules not processed for user `fd386a2f17364a108ed27fcb205a432c`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:22.616461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3d1ca783-52ae-4174-a9d4-925b0f86c73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:22.748753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1053/2100] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:22.752733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.778774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:22.875567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4af0e-d53f-4ecf-ad04-855c4e976300 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:22.886645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:22.887299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:22.887582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:22.887851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:22.888544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:22.891670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:22.950458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1048/2101] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:22 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:22.954928 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ca783-52ae-4174-a9d4-925b0f86c73c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:22.973180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ca783-52ae-4174-a9d4-925b0f86c73c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.016893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.018361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:23.094290 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:23.102808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.103447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.103725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.103996 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.104679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.107007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.114898 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead67f2a-45e8-4b4a-996f-e4d7da5c3c80 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.124045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.125756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.126177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.126731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] PATH_INFO: `/v3/projects/a9ab939ef0db410e95e4e185216456f0` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.128012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ab939ef0db410e95e4e185216456f0)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.130384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.147169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1054/2102] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:22 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:23.149354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.163076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad5c0-e920-4092-a953-67b51e19eb49 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.174661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.175341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.175870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.176196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.177036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.179509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.192888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ab939ef0db410e95e4e185216456f0', 'request_id': 'req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.199163 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1055/2103] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:23.202341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.203973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ab939ef0db410e95e4e185216456f0', 'request_id': 'req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.216366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc3673-3b1e-4a0d-9685-43bf946da7d2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.218446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ab939ef0db410e95e4e185216456f0', 'request_id': 'req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.237311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] The token cache is being invalidate because project a9ab939ef0db410e95e4e185216456f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:23.237620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.239133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.241582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1049/2104] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:23 2022] DELETE /identity/v3/projects/a9ab939ef0db410e95e4e185216456f0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:23.245637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.249240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:23.302727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.303562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.303901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.304645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] PATH_INFO: `/v3/projects/b38fac726953490291cf32190d2aca49/users/e3315660346d4e8588a9ae9bfe1329d3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.324111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:23.324310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38fac726953490291cf32190d2aca49, user_id=e3315660346d4e8588a9ae9bfe1329d3, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.328541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.348078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1056/2105] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:23 2022] PUT /identity/v3/projects/b38fac726953490291cf32190d2aca49/users/e3315660346d4e8588a9ae9bfe1329d3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:23.351341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.352967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:23.390096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c5481-13c5-4f2a-9a41-5df7ee233f48 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.453341 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159aea31-1f36-4cd6-b55a-1ae8f3c41919 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.460321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.461182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.461623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.462060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.463240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.464996 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.475563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.476723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.477017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.477332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] PATH_INFO: `/v3/users/6e097622a9ce4031b7322b963e9f35de` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.479006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e097622a9ce4031b7322b963e9f35de)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.482390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1057/2106] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:23.482525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.483896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.504158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0489c7-4801-4232-82fe-5fdf8bcd5773 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.505806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd622-335c-48e2-9253-f36edba6188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.506701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd622-335c-48e2-9253-f36edba6188b admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.507049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd622-335c-48e2-9253-f36edba6188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.507395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd622-335c-48e2-9253-f36edba6188b admin admin] PATH_INFO: `/v3/projects/b38fac726953490291cf32190d2aca49/users/e3315660346d4e8588a9ae9bfe1329d3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.509508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd622-335c-48e2-9253-f36edba6188b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38fac726953490291cf32190d2aca49, user_id=e3315660346d4e8588a9ae9bfe1329d3, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.513683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd622-335c-48e2-9253-f36edba6188b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.528505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1058/2107] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:23 2022] PUT /identity/v3/projects/b38fac726953490291cf32190d2aca49/users/e3315660346d4e8588a9ae9bfe1329d3/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:23.540563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e097622a9ce4031b7322b963e9f35de'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.542712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.543520 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.544230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.551687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e097622a9ce4031b7322b963e9f35de'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.573882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e097622a9ce4031b7322b963e9f35de'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.584241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e097622a9ce4031b7322b963e9f35de'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.585897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e097622a9ce4031b7322b963e9f35de'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:23.592376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] MFA Rules not processed for user `e3315660346d4e8588a9ae9bfe1329d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:23.593794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:23.594614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1050/2108] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:23 2022] DELETE /identity/v3/users/6e097622a9ce4031b7322b963e9f35de => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:23.631003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:23.689714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1059/2109] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:23.700999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.702817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:23.784432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c232-e1e4-4cac-8d6c-1c8569a2a907 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:23.789218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:23.789999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:23.790373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:23.790744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:23.793459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:23.809634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:23.895099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:23.897072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:23.909651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1051/2110] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:23.971226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:23.974476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:24.069064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809b6d-6b03-4f34-a33a-978e257a5fe3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:24.077984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:24.078790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.079155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.079522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] PATH_INFO: `/v3/projects/afdff78b891b42819a052518bde04078` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.080732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afdff78b891b42819a052518bde04078)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:24.083135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:24.144240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afdff78b891b42819a052518bde04078', 'request_id': 'req-052c0b09-87f1-43d7-ae49-8288f1381d83'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.152318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afdff78b891b42819a052518bde04078', 'request_id': 'req-052c0b09-87f1-43d7-ae49-8288f1381d83'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.158822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afdff78b891b42819a052518bde04078', 'request_id': 'req-052c0b09-87f1-43d7-ae49-8288f1381d83'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.171045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] The token cache is being invalidate because project afdff78b891b42819a052518bde04078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:24.171338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.171993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.173869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1060/2111] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:23 2022] DELETE /identity/v3/projects/afdff78b891b42819a052518bde04078 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:24.178472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:24.199095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab045b-fba4-4766-b73d-35279b4c6a4c service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:24.294754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:24.295503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.295983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.296330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] PATH_INFO: `/v3/users/1784bd4862b44d43aeba04a8f8c6bf45` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.297622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1784bd4862b44d43aeba04a8f8c6bf45)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:24.299733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:24.364872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1784bd4862b44d43aeba04a8f8c6bf45'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.375557 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1784bd4862b44d43aeba04a8f8c6bf45'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.389356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1784bd4862b44d43aeba04a8f8c6bf45'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.396379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1784bd4862b44d43aeba04a8f8c6bf45'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.397039 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-088d0fb4-fafe-4b66-9157-2b3f8d2802f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1784bd4862b44d43aeba04a8f8c6bf45'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.403159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1052/2112] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:24 2022] DELETE /identity/v3/users/1784bd4862b44d43aeba04a8f8c6bf45 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:24.461175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:24.463239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:24.479610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0b09-87f1-43d7-ae49-8288f1381d83 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:24.538600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:24.546741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:24.548676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.549398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.549737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] PATH_INFO: `/v3/users/7c3f11da00f4429ab0e05b5a8f94ddac` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.551345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3f11da00f4429ab0e05b5a8f94ddac)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:24.557863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:24.609138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3f11da00f4429ab0e05b5a8f94ddac'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.616156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3f11da00f4429ab0e05b5a8f94ddac'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.624450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3f11da00f4429ab0e05b5a8f94ddac'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.636302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3f11da00f4429ab0e05b5a8f94ddac'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.637006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3f11da00f4429ab0e05b5a8f94ddac'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.643598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1061/2113] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:24 2022] DELETE /identity/v3/users/7c3f11da00f4429ab0e05b5a8f94ddac => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:24.648377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.648606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.648872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.668010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:24.669214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:24.687199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:24.689014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:24.698215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:24.746267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1053/2114] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:24.756792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:24.758448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:24.765042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ca3f9-0fa4-4ccf-985e-8ec163db2b6e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:24.769879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:24.770532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.770863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.771143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] PATH_INFO: `/v3/projects/e02a678799f14bc8a7c9aa4aa8658227` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.772328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02a678799f14bc8a7c9aa4aa8658227)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:24.774379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:24.818362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b607-b430-4b6a-b3bc-e26ce84d918b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:24.828187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02a678799f14bc8a7c9aa4aa8658227', 'request_id': 'req-a10adf09-397f-40cd-a240-478aaf90e4c4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.838466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02a678799f14bc8a7c9aa4aa8658227', 'request_id': 'req-a10adf09-397f-40cd-a240-478aaf90e4c4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.845618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02a678799f14bc8a7c9aa4aa8658227', 'request_id': 'req-a10adf09-397f-40cd-a240-478aaf90e4c4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.857488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] The token cache is being invalidate because project e02a678799f14bc8a7c9aa4aa8658227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:24.857780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.858563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a10adf09-397f-40cd-a240-478aaf90e4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:24.860111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1062/2115] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:24 2022] DELETE /identity/v3/projects/e02a678799f14bc8a7c9aa4aa8658227 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:24.866492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521868e-d110-4e96-9464-21d17219901b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.866778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521868e-d110-4e96-9464-21d17219901b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.867418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521868e-d110-4e96-9464-21d17219901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.878953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:24.885841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:24.886485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.886810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.887055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.889145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:24.893034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3521868e-d110-4e96-9464-21d17219901b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:24.894795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3521868e-d110-4e96-9464-21d17219901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:24.966383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1063/2116] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:24.974280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:24.975387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1961b-96a6-40fa-930d-26d1c3fad93c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:24.975673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1961b-96a6-40fa-930d-26d1c3fad93c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:24.975784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:24.975949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1961b-96a6-40fa-930d-26d1c3fad93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:24.985437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1054/2117] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:24.994952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c7a1961b-96a6-40fa-930d-26d1c3fad93c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:24.996153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c7a1961b-96a6-40fa-930d-26d1c3fad93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:25.004275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1064/2118] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:25.008533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.018388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c109459-b546-4bfe-84e3-e44f2c1022ce service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.023042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.023657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.023939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.024216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.024920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:25.025428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.027174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.039047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1055/2119] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:33:25.043905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1961b-96a6-40fa-930d-26d1c3fad93c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.054887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1961b-96a6-40fa-930d-26d1c3fad93c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.061105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.061887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.062272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.062635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.063320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.065317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.095732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1065/2120] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:25.100340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.112544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e420d35-722e-4ddc-b926-67e6901012e9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.146082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:25.187724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.188365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.188758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.189108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.189895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.191893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.216692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1056/2121] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:25.220842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.233647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e482b-fd6c-4b64-9218-9e1d24137acd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.241181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.242068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.243011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.243359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.244146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.245909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.267321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1066/2122] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:25.272353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.280347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.283361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:25.287663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d250d5-5729-4017-91c7-afa1cb77227b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.301413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.303724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.304090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.304475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.309344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.309344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.324162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05893016-4f45-46d7-82a8-a593eda84d84 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.330896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1057/2123] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:25.331159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.331159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.331159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.331451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] PATH_INFO: `/v3/projects/c618e372af7c46ed81ff3cdc5f15a39d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.332919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.333042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c618e372af7c46ed81ff3cdc5f15a39d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.334911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.345498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721b65-4590-4b5d-9cff-af1c18de14f3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.352700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c11d-0825-48f3-9650-f610ea082fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.353464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c11d-0825-48f3-9650-f610ea082fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.353759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c11d-0825-48f3-9650-f610ea082fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.354040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c11d-0825-48f3-9650-f610ea082fc6 admin admin] PATH_INFO: `/v3/projects/840cc4c08152434aabe5b664ea574d0c/users/037d7f9e041d4a3c892da33035736a09/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.371167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246c11d-0825-48f3-9650-f610ea082fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840cc4c08152434aabe5b664ea574d0c, user_id=037d7f9e041d4a3c892da33035736a09, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.376008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246c11d-0825-48f3-9650-f610ea082fc6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.393557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c618e372af7c46ed81ff3cdc5f15a39d', 'request_id': 'req-e9a2b439-67ae-4776-bf92-680b2a458a37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:25.400922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1058/2124] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:25 2022] PUT /identity/v3/projects/840cc4c08152434aabe5b664ea574d0c/users/037d7f9e041d4a3c892da33035736a09/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:25.409868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c618e372af7c46ed81ff3cdc5f15a39d', 'request_id': 'req-e9a2b439-67ae-4776-bf92-680b2a458a37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:25.412555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.413051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.413529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.420192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c618e372af7c46ed81ff3cdc5f15a39d', 'request_id': 'req-e9a2b439-67ae-4776-bf92-680b2a458a37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:25.437056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] The token cache is being invalidate because project c618e372af7c46ed81ff3cdc5f15a39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:25.437497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:25.438617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e9a2b439-67ae-4776-bf92-680b2a458a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:25.444582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1067/2125] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:25 2022] DELETE /identity/v3/projects/c618e372af7c46ed81ff3cdc5f15a39d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:25.444748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] MFA Rules not processed for user `037d7f9e041d4a3c892da33035736a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:25.445815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:25.446626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73fc5-1696-4bdf-8689-045f03e0fc5a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.447114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73fc5-1696-4bdf-8689-045f03e0fc5a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.447659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73fc5-1696-4bdf-8689-045f03e0fc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.469124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a4b73fc5-1696-4bdf-8689-045f03e0fc5a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:25.470413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a4b73fc5-1696-4bdf-8689-045f03e0fc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:25.511083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1059/2126] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:25.512966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:25.515501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.516887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:25.530334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1068/2127] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:25.589775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065288f-858b-4913-aac4-66d8b0c58c9b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.594530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.595259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.595866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.595866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.596551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.598539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.601531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d390-7e0a-41e1-af94-eed84fedd90e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.601937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d390-7e0a-41e1-af94-eed84fedd90e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.602239 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d390-7e0a-41e1-af94-eed84fedd90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.611571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:25.629483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2959d390-7e0a-41e1-af94-eed84fedd90e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:25.630742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2959d390-7e0a-41e1-af94-eed84fedd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:25.638388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1060/2128] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:25.639558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1069/2129] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:25.643107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.643543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d390-7e0a-41e1-af94-eed84fedd90e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.653798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d390-7e0a-41e1-af94-eed84fedd90e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.713738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23722-a629-4d3d-961d-2a9408535710 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.715305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.716124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.716487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.716765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.717504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:25.717809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.719433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.722525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.723357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.723839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.724292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.725140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.727394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.735139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1070/2130] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:25.736514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.749091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96774293-9f77-41ce-ac74-09391d143a33 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.754822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.755070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1061/2131] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:25.755918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.756263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.756670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.757436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.759256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.760198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.770749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99736f-e60e-44a3-bb41-69bb70291fcd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.775885 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.776874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.777365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.777818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.778821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.780604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.793331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1062/2132] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:25.797782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.804372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1071/2133] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:25.811212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.813085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766e48-23a4-471f-b7c5-4ff9133cc20d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.878800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.879846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.880326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.880828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] PATH_INFO: `/v3/projects/00c1f80a06da4213a21493b19c59db7f/users/f2e83f0346b64e9681817112c2639e0b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.881791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59980f2b-8fb4-4099-9dc9-af911f848244 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.886515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:25.887149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:25.887429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:25.887703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:25.888440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.890338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.897916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c1f80a06da4213a21493b19c59db7f, user_id=f2e83f0346b64e9681817112c2639e0b, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:25.900689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:25.915185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1072/2134] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:25 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:25.919930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1063/2135] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:25 2022] PUT /identity/v3/projects/00c1f80a06da4213a21493b19c59db7f/users/f2e83f0346b64e9681817112c2639e0b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:25.923816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.923948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:25.934235 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f60b3-e8a4-4d2e-8b9d-e51735fcd2d3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:25.986059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:25.992723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:26.000789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78c4ec-a5fa-447f-b57c-7ef1addc026a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:26.006036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.006666 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.006953 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.007228 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.007932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.009639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.010638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.011269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.011552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.011831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.012535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.014199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.021108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1064/2136] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:26.025248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:26.027860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1073/2137] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:26.031551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:26.038563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4943836-d923-4fa8-8f2f-c79a399472d7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:26.042892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530487f3-09b7-4810-addc-b61c37cabea8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:26.043242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85806f0e-e535-479c-8265-e773b624d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.043910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85806f0e-e535-479c-8265-e773b624d8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.044191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85806f0e-e535-479c-8265-e773b624d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.044490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85806f0e-e535-479c-8265-e773b624d8a0 admin admin] PATH_INFO: `/v3/projects/00c1f80a06da4213a21493b19c59db7f/users/f2e83f0346b64e9681817112c2639e0b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.046420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85806f0e-e535-479c-8265-e773b624d8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c1f80a06da4213a21493b19c59db7f, user_id=f2e83f0346b64e9681817112c2639e0b, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.048254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.048937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.049146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85806f0e-e535-479c-8265-e773b624d8a0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.049345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.050338 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.050443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.052226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.059962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1065/2138] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:26 2022] PUT /identity/v3/projects/00c1f80a06da4213a21493b19c59db7f/users/f2e83f0346b64e9681817112c2639e0b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:26.068225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1074/2139] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:26.070983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.071284 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.071565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.072414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:26.083464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2a2b9-fada-46c6-8e5f-e90cb168671a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:26.105564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] MFA Rules not processed for user `f2e83f0346b64e9681817112c2639e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:26.106938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:26.151920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104ac29-943f-4552-a123-bd66d2aa496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.152894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104ac29-943f-4552-a123-bd66d2aa496a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.153005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104ac29-943f-4552-a123-bd66d2aa496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.153323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104ac29-943f-4552-a123-bd66d2aa496a admin admin] PATH_INFO: `/v3/projects/2d2c1ad1df094351abbd04bcb3fdaa41/users/5e491444e04a44a0af74bec3b67c90ce/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.167805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104ac29-943f-4552-a123-bd66d2aa496a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2c1ad1df094351abbd04bcb3fdaa41, user_id=5e491444e04a44a0af74bec3b67c90ce, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.170505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104ac29-943f-4552-a123-bd66d2aa496a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.185016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1075/2140] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:26 2022] PUT /identity/v3/projects/2d2c1ad1df094351abbd04bcb3fdaa41/users/5e491444e04a44a0af74bec3b67c90ce/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:26.186855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1066/2141] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:26.195624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.195913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.196188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.198331 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:26.199763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:26.226526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] MFA Rules not processed for user `5e491444e04a44a0af74bec3b67c90ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:26.227654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:26.265716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3404fef-2c7a-4a1e-acd6-38aec7597330 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:26.301417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1076/2142] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:26.313104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:26.314710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:26.315398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.316065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.316351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.316628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.328314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56cbc-a525-43f8-9c57-02ba5ec5b391 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:26.332900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.333553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.333834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.334195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.344322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.346085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.351173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:26.359828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1077/2143] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:26.388187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.389677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.399630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1067/2144] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:26.783190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:26.795588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded0964-f471-4d81-8f95-ca1dfb6eef30 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:26.795946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05179bd-30d2-445e-9684-bb79893e56f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:26.796597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05179bd-30d2-445e-9684-bb79893e56f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:26.796878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05179bd-30d2-445e-9684-bb79893e56f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:26.797152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05179bd-30d2-445e-9684-bb79893e56f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:26.799065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c05179bd-30d2-445e-9684-bb79893e56f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:26.834245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:26.869041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05179bd-30d2-445e-9684-bb79893e56f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:26.870548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05179bd-30d2-445e-9684-bb79893e56f5 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:26.882953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1078/2145] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:26.997728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:27.062179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432855b1-7413-40f4-a923-55fcf7b41f8b service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:27.067043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:27.067697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:27.067985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:27.068267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] PATH_INFO: `/v3/users/037d7f9e041d4a3c892da33035736a09` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:27.069472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=037d7f9e041d4a3c892da33035736a09)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:27.071410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:27.121233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037d7f9e041d4a3c892da33035736a09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.129112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037d7f9e041d4a3c892da33035736a09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.141837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037d7f9e041d4a3c892da33035736a09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.150092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037d7f9e041d4a3c892da33035736a09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.150769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037d7f9e041d4a3c892da33035736a09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.156680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1068/2146] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:26 2022] DELETE /identity/v3/users/037d7f9e041d4a3c892da33035736a09 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:27.161345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:27.161636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:27.161909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:27.180909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:27.182225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:27.253104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1079/2147] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:27.260046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:27.262433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:27.324966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:27.332809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c235d-ce04-4b56-a55e-2da88dca6f3c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:27.337792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:27.339033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:27.340031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:27.340709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:27.352401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:27.353957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:27.365023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1069/2148] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:27.533144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:27.535056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:27.619639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400fd68-d151-4995-bfe3-915ad5a44b01 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:27.624307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:27.625078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:27.625469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:27.625813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:27.627949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:27.645661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:27.647453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:27.672117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe8a93-fa46-435e-8199-3767f12901d7 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:27.678638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:27.679812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:27.680361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:27.680897 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] PATH_INFO: `/v3/projects/840cc4c08152434aabe5b664ea574d0c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:27.682781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840cc4c08152434aabe5b664ea574d0c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:27.686119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:27.730777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:27.735641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:27.753162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1080/2149] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:27.782956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840cc4c08152434aabe5b664ea574d0c', 'request_id': 'req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.789580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840cc4c08152434aabe5b664ea574d0c', 'request_id': 'req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.798174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840cc4c08152434aabe5b664ea574d0c', 'request_id': 'req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.812017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] The token cache is being invalidate because project 840cc4c08152434aabe5b664ea574d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:27.812473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.813313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.815135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1070/2150] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:27 2022] DELETE /identity/v3/projects/840cc4c08152434aabe5b664ea574d0c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:27.819130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:27.833554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530a5b5-fbbe-4d46-a37a-5ca31825b8c6 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:27.853353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:27.915127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:27.915806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:27.916143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:27.916366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] PATH_INFO: `/v3/users/f2e83f0346b64e9681817112c2639e0b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:27.917640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e83f0346b64e9681817112c2639e0b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:27.919768 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:27.974979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e83f0346b64e9681817112c2639e0b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.983026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e83f0346b64e9681817112c2639e0b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:27.991157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e83f0346b64e9681817112c2639e0b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.003545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e83f0346b64e9681817112c2639e0b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.004206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2395206f-8ed4-40e0-a219-194fd3dba170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e83f0346b64e9681817112c2639e0b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.010366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1081/2151] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:27 2022] DELETE /identity/v3/users/f2e83f0346b64e9681817112c2639e0b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:28.291920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:28.294032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:28.310894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0fd15-ee60-4c28-8592-bcbf6d0f6071 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:28.381589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:28.382278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.382561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.382840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] PATH_INFO: `/v3/projects/00c1f80a06da4213a21493b19c59db7f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.384203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c1f80a06da4213a21493b19c59db7f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:28.386368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:28.435297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c1f80a06da4213a21493b19c59db7f', 'request_id': 'req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.441561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c1f80a06da4213a21493b19c59db7f', 'request_id': 'req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.451419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c1f80a06da4213a21493b19c59db7f', 'request_id': 'req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.468800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] The token cache is being invalidate because project 00c1f80a06da4213a21493b19c59db7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:28.469106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.469821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d62a52a1-90c1-49ba-b9d5-e130b455ddaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:28.471721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1071/2152] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:28 2022] DELETE /identity/v3/projects/00c1f80a06da4213a21493b19c59db7f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:28.476672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543d93-fac9-4c0a-8a91-8ffd853c02e1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.477167 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543d93-fac9-4c0a-8a91-8ffd853c02e1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.477482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543d93-fac9-4c0a-8a91-8ffd853c02e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.503221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6c543d93-fac9-4c0a-8a91-8ffd853c02e1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:28.504464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6c543d93-fac9-4c0a-8a91-8ffd853c02e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:28.565669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1082/2153] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:28.573600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750afe8-b7bb-4bb9-b36c-094263568e90 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.573922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750afe8-b7bb-4bb9-b36c-094263568e90 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.574207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750afe8-b7bb-4bb9-b36c-094263568e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.582563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:28.598117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2750afe8-b7bb-4bb9-b36c-094263568e90 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:28.599394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2750afe8-b7bb-4bb9-b36c-094263568e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:28.608404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1072/2154] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:28.612748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c543d93-fac9-4c0a-8a91-8ffd853c02e1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:28.622753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c543d93-fac9-4c0a-8a91-8ffd853c02e1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:28.627471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:28.628087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.628367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.628640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.629374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:28.629681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:28.631331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:28.642824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1083/2155] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:28.646946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750afe8-b7bb-4bb9-b36c-094263568e90 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:28.656222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750afe8-b7bb-4bb9-b36c-094263568e90 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:28.661180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:28.661826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.662110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.662381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.663066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:28.664988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:28.693788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1073/2156] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:28 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:28.697268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:28.708066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcc96d-4254-4d7a-9072-9fdd263d36e2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:28.729732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:28.769869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:28.770443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.770727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.771004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.771675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:28.773637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:28.796480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1084/2157] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:28 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:28.800998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:28.811706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604335-ddbb-4c3c-880b-ff04ca09eb5f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:28.817246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:28.817907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.818183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.818449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.819150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:28.820861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:28.832633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1074/2158] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:28.836741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:28.847643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155535-59cb-47d4-ba5a-42dd9df494c9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:28.853461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4066375-4e11-4113-a628-c9179e4de354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:28.854180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4066375-4e11-4113-a628-c9179e4de354 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.854609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4066375-4e11-4113-a628-c9179e4de354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.855007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4066375-4e11-4113-a628-c9179e4de354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.855885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4066375-4e11-4113-a628-c9179e4de354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:28.857851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4066375-4e11-4113-a628-c9179e4de354 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:28.872948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1085/2159] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:28.874083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:28.894682 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61586b-14ef-44c8-9f47-9554de4be277 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:28.899448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:28.900115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.900451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.900733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] PATH_INFO: `/v3/projects/1d0e713805ec4f7782e3eec683f5618e/users/72c35ee7dad249439f6e4af76582b377/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.917068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0e713805ec4f7782e3eec683f5618e, user_id=72c35ee7dad249439f6e4af76582b377, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:28.919756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:28.946437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1075/2160] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:28 2022] PUT /identity/v3/projects/1d0e713805ec4f7782e3eec683f5618e/users/72c35ee7dad249439f6e4af76582b377/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:28.957840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:28.958250 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:28.958648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:28.993024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] MFA Rules not processed for user `72c35ee7dad249439f6e4af76582b377`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:28.994672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:29.087948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1086/2161] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:29.092560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.162156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.163725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:29.190942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183cda-69b4-40ee-be12-385a777227b6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.201406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.207473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.207842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.208134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.208909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.212588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.269184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10660c-987e-4587-8da8-a70399e6a5fd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.277475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1076/2162] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:29 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:29.280782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.281513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.281633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.282121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.282393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] PATH_INFO: `/v3/users/1385b32b1f474f11a329c0082139e6b9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.283899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1385b32b1f474f11a329c0082139e6b9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.286466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.341040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:29.358648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1385b32b1f474f11a329c0082139e6b9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:29.368143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1385b32b1f474f11a329c0082139e6b9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:29.370341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98d5cc-d3f2-4fdd-beb9-cabf5efb9202 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.376591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.377938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1385b32b1f474f11a329c0082139e6b9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:29.378061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.378061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.378199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.379025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.381308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.397969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1385b32b1f474f11a329c0082139e6b9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:29.399138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2662477-43b3-459c-ba18-9bcf0931051b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1385b32b1f474f11a329c0082139e6b9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:29.407229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1087/2163] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:29 2022] DELETE /identity/v3/users/1385b32b1f474f11a329c0082139e6b9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:29.411552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3bce-c16b-4321-bc3e-d4547c39ff80 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.411842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3bce-c16b-4321-bc3e-d4547c39ff80 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.412125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3bce-c16b-4321-bc3e-d4547c39ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.413959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1077/2164] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:29 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:29.418271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.419962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:29.432823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7c191-f946-4ab7-bd56-f7bd958436b5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.439859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f8ee3bce-c16b-4321-bc3e-d4547c39ff80 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:29.441240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f8ee3bce-c16b-4321-bc3e-d4547c39ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:29.443528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:29.504444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.505136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.505464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.505735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.506450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.508297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.519085 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1088/2165] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:29.519940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1078/2166] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:29.523824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee3bce-c16b-4321-bc3e-d4547c39ff80 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.526059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.528040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:29.535346 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee3bce-c16b-4321-bc3e-d4547c39ff80 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.541449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.542365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.542715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.543062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] PATH_INFO: `/v3/projects/8479406d46a341eabfa4a7b88da0d808/users/09d52dcd4530478c8731ad01040065b8/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.564721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8479406d46a341eabfa4a7b88da0d808, user_id=09d52dcd4530478c8731ad01040065b8, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.568799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.592567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1089/2167] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:29 2022] PUT /identity/v3/projects/8479406d46a341eabfa4a7b88da0d808/users/09d52dcd4530478c8731ad01040065b8/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:29.596600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.598167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b393-5426-4c11-8bf2-f87189485bd4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.650972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.651605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.651889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.652350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.675548 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeca034-768d-46db-86ff-0c8b8b0cf59a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.681667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.682382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.682666 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.682925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.683776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.685642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.696698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1090/2168] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:29.701458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.719665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508941-9c6f-4b01-8b75-1386ffcff3a7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:29.725183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f5bda-34ec-45a2-a1b9-a1b6618634e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:29.726375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5bda-34ec-45a2-a1b9-a1b6618634e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.726375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5bda-34ec-45a2-a1b9-a1b6618634e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.726594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5bda-34ec-45a2-a1b9-a1b6618634e6 admin admin] PATH_INFO: `/v3/projects/8479406d46a341eabfa4a7b88da0d808/users/09d52dcd4530478c8731ad01040065b8/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.729026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f5bda-34ec-45a2-a1b9-a1b6618634e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8479406d46a341eabfa4a7b88da0d808, user_id=09d52dcd4530478c8731ad01040065b8, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.732467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f5bda-34ec-45a2-a1b9-a1b6618634e6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.759454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1091/2169] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:29 2022] PUT /identity/v3/projects/8479406d46a341eabfa4a7b88da0d808/users/09d52dcd4530478c8731ad01040065b8/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:29.765502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:29.766106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:29.771002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:29.771385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:29.771877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:29.776675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1079/2170] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:29.796160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:29.805689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] MFA Rules not processed for user `09d52dcd4530478c8731ad01040065b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:29.808760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:29.895555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1092/2171] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:29.909895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:29.911476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:29.930951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:30.001999 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020625d-1477-4ba0-9933-6008fb93f544 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:30.070487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db04dd9-6c98-4191-af00-8edf8e1cb354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:30.071223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04dd9-6c98-4191-af00-8edf8e1cb354 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:30.071573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04dd9-6c98-4191-af00-8edf8e1cb354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:30.071921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04dd9-6c98-4191-af00-8edf8e1cb354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:30.074013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5db04dd9-6c98-4191-af00-8edf8e1cb354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.167981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:30.169662 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.181403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db04dd9-6c98-4191-af00-8edf8e1cb354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:30.183681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db04dd9-6c98-4191-af00-8edf8e1cb354 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:30.196582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1080/2172] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:30.318208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa276a-7e54-404e-aa49-21471eae2fe4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:30.323896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:30.324727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:30.325271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:30.326251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] PATH_INFO: `/v3/users/5e491444e04a44a0af74bec3b67c90ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:30.327593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e491444e04a44a0af74bec3b67c90ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:30.329785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:30.412683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e491444e04a44a0af74bec3b67c90ce'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.434736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e491444e04a44a0af74bec3b67c90ce'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.457165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e491444e04a44a0af74bec3b67c90ce'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.489309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e491444e04a44a0af74bec3b67c90ce'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.489999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e491444e04a44a0af74bec3b67c90ce'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.504578 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1093/2173] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:30 2022] DELETE /identity/v3/users/5e491444e04a44a0af74bec3b67c90ce => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:30.511160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:30.511584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:30.512119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:30.550166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:30.552954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.596195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:30.598108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.636114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:30.657601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1081/2174] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:30.668982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:30.671375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.700193 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b75371-cf80-4d74-afc3-01436125bbb8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:30.705767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:30.707063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:30.707545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:30.707828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] PATH_INFO: `/v3/projects/e975c3c7016d4d8eb02ce32d3c199e2f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:30.709179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e975c3c7016d4d8eb02ce32d3c199e2f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:30.711327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:30.725481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:30.778561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2a19-5195-43f9-9cb2-8e2f3fa7787b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:30.794476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e975c3c7016d4d8eb02ce32d3c199e2f', 'request_id': 'req-c729d62f-8c77-40ba-a6f1-de5383e1c597'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.815483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e975c3c7016d4d8eb02ce32d3c199e2f', 'request_id': 'req-c729d62f-8c77-40ba-a6f1-de5383e1c597'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.823351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e975c3c7016d4d8eb02ce32d3c199e2f', 'request_id': 'req-c729d62f-8c77-40ba-a6f1-de5383e1c597'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.843940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] The token cache is being invalidate because project e975c3c7016d4d8eb02ce32d3c199e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:30.844522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.845723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c729d62f-8c77-40ba-a6f1-de5383e1c597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:30.849354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1094/2175] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:30 2022] DELETE /identity/v3/projects/e975c3c7016d4d8eb02ce32d3c199e2f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:30.856234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755450-7d58-42e2-bdee-4c50182dfd4a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:30.856581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755450-7d58-42e2-bdee-4c50182dfd4a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:30.856902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755450-7d58-42e2-bdee-4c50182dfd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:30.877215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:30.878145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:30.878905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:30.879777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:30.883202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-96755450-7d58-42e2-bdee-4c50182dfd4a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:30.883566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.884551 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-96755450-7d58-42e2-bdee-4c50182dfd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.956258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1095/2176] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:30.966145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecfff-f5b8-4ab1-85e3-2a3ed7b9822f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:30.966145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecfff-f5b8-4ab1-85e3-2a3ed7b9822f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:30.966431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecfff-f5b8-4ab1-85e3-2a3ed7b9822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:30.986221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-406ecfff-f5b8-4ab1-85e3-2a3ed7b9822f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:30.987437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-406ecfff-f5b8-4ab1-85e3-2a3ed7b9822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:30.993324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:30.994735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.001321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1096/2177] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:31.006428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1082/2178] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:31.007637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecfff-f5b8-4ab1-85e3-2a3ed7b9822f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.016932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecfff-f5b8-4ab1-85e3-2a3ed7b9822f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.021583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.022415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.022532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.022895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.023785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:31.024019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.025696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.037794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1097/2179] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:31.042151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.052738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924224-6ff2-4bc9-9086-6af9d0836e64 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.057910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.058530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.058881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.059277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.059964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.062167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.091188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1083/2180] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:31 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:31.095440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.105700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c3b00-cc56-497c-b3dd-d8695e6626e7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.133685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:31.171706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.172347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.172632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.172989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.173717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.175711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.205331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1098/2181] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:31 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:31.207864 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.218198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772cf2f-50e9-4982-91a1-42571b08c13c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.222920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.223534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.223814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.224089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.224792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.226429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.239410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1084/2182] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:31.244733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.263719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d0e0-9385-4c71-a0d2-f7bfcc6849a2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.269908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.270543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.270908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.271270 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.272012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.273675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.286933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1099/2183] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:31.290876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.301644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.303415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:31.304224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46828-baee-422c-a28f-d63d0ae8ca72 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.310030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a8dba-b7e1-42a7-a478-437114a29332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.310862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8dba-b7e1-42a7-a478-437114a29332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.311155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8dba-b7e1-42a7-a478-437114a29332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.311567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8dba-b7e1-42a7-a478-437114a29332 admin admin] PATH_INFO: `/v3/projects/edd69fdb0456488ea55e4f0300c7c71c/users/d0bf92e49f394601beee0d550ed093d4/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.318132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b731-be4d-4fe5-bc49-10df6a348d71 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.331141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.332185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.332468 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.333778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] PATH_INFO: `/v3/projects/2d2c1ad1df094351abbd04bcb3fdaa41` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.335784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2c1ad1df094351abbd04bcb3fdaa41)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.337821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.339251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a8dba-b7e1-42a7-a478-437114a29332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd69fdb0456488ea55e4f0300c7c71c, user_id=d0bf92e49f394601beee0d550ed093d4, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.342573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a8dba-b7e1-42a7-a478-437114a29332 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.360013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1085/2184] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:31 2022] PUT /identity/v3/projects/edd69fdb0456488ea55e4f0300c7c71c/users/d0bf92e49f394601beee0d550ed093d4/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:31.370334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.370625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.371008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.392377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2c1ad1df094351abbd04bcb3fdaa41', 'request_id': 'req-080c9cfe-08b9-4cd2-8899-b0fa4085447f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:31.403192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2c1ad1df094351abbd04bcb3fdaa41', 'request_id': 'req-080c9cfe-08b9-4cd2-8899-b0fa4085447f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:31.408618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] MFA Rules not processed for user `d0bf92e49f394601beee0d550ed093d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:31.409904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:31.413824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2c1ad1df094351abbd04bcb3fdaa41', 'request_id': 'req-080c9cfe-08b9-4cd2-8899-b0fa4085447f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:31.431224 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] The token cache is being invalidate because project 2d2c1ad1df094351abbd04bcb3fdaa41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:31.431515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:31.432408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:31.434326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1100/2185] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:31 2022] DELETE /identity/v3/projects/2d2c1ad1df094351abbd04bcb3fdaa41 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:31.454889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:31.515769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1086/2186] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:31.528247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:31.530383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:31.598517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c9cfe-08b9-4cd2-8899-b0fa4085447f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:31.603096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af01fc-6404-4b32-93b4-1fd9ec1ec734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:31.603829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af01fc-6404-4b32-93b4-1fd9ec1ec734 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:31.604244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af01fc-6404-4b32-93b4-1fd9ec1ec734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:31.604592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af01fc-6404-4b32-93b4-1fd9ec1ec734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:31.615973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af01fc-6404-4b32-93b4-1fd9ec1ec734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:31.618173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af01fc-6404-4b32-93b4-1fd9ec1ec734 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:31.657515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1101/2187] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:32.106383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:32.108432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:32.204286 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243748-ff87-4525-b3a8-0ae394b84a9f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:32.221663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:32.222461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:32.222983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:32.223363 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] PATH_INFO: `/v3/users/b68c963132e94f65b7234ad8b5412e02` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:32.225503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68c963132e94f65b7234ad8b5412e02)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:32.227942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:32.292455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68c963132e94f65b7234ad8b5412e02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.313951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68c963132e94f65b7234ad8b5412e02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.326925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68c963132e94f65b7234ad8b5412e02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.334370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68c963132e94f65b7234ad8b5412e02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.335141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68c963132e94f65b7234ad8b5412e02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.341806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1087/2188] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:32 2022] DELETE /identity/v3/users/b68c963132e94f65b7234ad8b5412e02 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:32.346828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:32.347298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:32.347389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:32.367241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:32.368456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:32.394257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:32.430109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1102/2189] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:32.440651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:32.442289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:32.494410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:32.504742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8098c-d19f-4e1c-8c11-2080a1942b8e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:32.509106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:32.509790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:32.510302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:32.510586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:32.520169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:32.521646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:32.531411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1088/2190] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:32.798191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:32.799631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:32.812449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828e2f5-8dbb-43d3-9d64-6b869dbd2945 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:32.818697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:32.819369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:32.820124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:32.820124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] PATH_INFO: `/v3/projects/b9dd87f91da84733a55f7526f9c6b97c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:32.821262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9dd87f91da84733a55f7526f9c6b97c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:32.823380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:32.873631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dd87f91da84733a55f7526f9c6b97c', 'request_id': 'req-1d9afa50-0978-4098-88af-e323804028d8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.882382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dd87f91da84733a55f7526f9c6b97c', 'request_id': 'req-1d9afa50-0978-4098-88af-e323804028d8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.888675 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dd87f91da84733a55f7526f9c6b97c', 'request_id': 'req-1d9afa50-0978-4098-88af-e323804028d8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.900364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] The token cache is being invalidate because project b9dd87f91da84733a55f7526f9c6b97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:32.900885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.901623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:32.903181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1103/2191] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:32 2022] DELETE /identity/v3/projects/b9dd87f91da84733a55f7526f9c6b97c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:32.907551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:32.918329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015674-4358-425d-a103-cc1584bd9805 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:32.985594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:32.986270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:32.986560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:32.986866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] PATH_INFO: `/v3/users/fd386a2f17364a108ed27fcb205a432c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:32.988223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd386a2f17364a108ed27fcb205a432c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:32.990289 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:33.043313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd386a2f17364a108ed27fcb205a432c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.061580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd386a2f17364a108ed27fcb205a432c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.068227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd386a2f17364a108ed27fcb205a432c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.076325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd386a2f17364a108ed27fcb205a432c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.077546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd386a2f17364a108ed27fcb205a432c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.085172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1089/2192] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:32 2022] DELETE /identity/v3/users/fd386a2f17364a108ed27fcb205a432c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:33.653543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:33.656112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:33.672053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9afa50-0978-4098-88af-e323804028d8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:33.738098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:33.738765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:33.739115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:33.739458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] PATH_INFO: `/v3/projects/59240b56187d4c3c8486e39a7b504a31` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:33.740879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59240b56187d4c3c8486e39a7b504a31)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:33.742956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:33.793303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59240b56187d4c3c8486e39a7b504a31', 'request_id': 'req-b7a522a0-26d8-41a5-ad79-d7bff436611b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.802300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59240b56187d4c3c8486e39a7b504a31', 'request_id': 'req-b7a522a0-26d8-41a5-ad79-d7bff436611b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.803635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:33.809434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59240b56187d4c3c8486e39a7b504a31', 'request_id': 'req-b7a522a0-26d8-41a5-ad79-d7bff436611b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.821806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] The token cache is being invalidate because project 59240b56187d4c3c8486e39a7b504a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:33.822658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.823388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.824963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1104/2193] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:33 2022] DELETE /identity/v3/projects/59240b56187d4c3c8486e39a7b504a31 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:33.829146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:33.830583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:33.844092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a047b9-6ac0-4cd8-9534-09cbcbcd7dcc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:33.905413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:33.906271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:33.906676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:33.906933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] PATH_INFO: `/v3/users/e3315660346d4e8588a9ae9bfe1329d3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:33.908204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3315660346d4e8588a9ae9bfe1329d3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:33.910630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:33.917974 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:33.962432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3315660346d4e8588a9ae9bfe1329d3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.973106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3315660346d4e8588a9ae9bfe1329d3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.985633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3315660346d4e8588a9ae9bfe1329d3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.992772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3315660346d4e8588a9ae9bfe1329d3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.993581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-09b97a47-cacd-4405-9160-ebfdc82dd0f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3315660346d4e8588a9ae9bfe1329d3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:33.999989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1090/2194] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:33 2022] DELETE /identity/v3/users/e3315660346d4e8588a9ae9bfe1329d3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:34.340367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:34.341988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:34.356524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a522a0-26d8-41a5-ad79-d7bff436611b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:34.434368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:34.435024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.435308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.435586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] PATH_INFO: `/v3/projects/b38fac726953490291cf32190d2aca49` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.436766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38fac726953490291cf32190d2aca49)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:34.438897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:34.488588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38fac726953490291cf32190d2aca49', 'request_id': 'req-41e1d24e-95a2-457a-b00d-1e0285c1dae0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:34.499495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38fac726953490291cf32190d2aca49', 'request_id': 'req-41e1d24e-95a2-457a-b00d-1e0285c1dae0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:34.507245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38fac726953490291cf32190d2aca49', 'request_id': 'req-41e1d24e-95a2-457a-b00d-1e0285c1dae0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:34.523368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] The token cache is being invalidate because project b38fac726953490291cf32190d2aca49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:34.523661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:34.525269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-41e1d24e-95a2-457a-b00d-1e0285c1dae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:34.528132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1105/2195] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:34 2022] DELETE /identity/v3/projects/b38fac726953490291cf32190d2aca49 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:34.534478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99939f61-e1af-4281-a96b-23a03f1a31c5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.534771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99939f61-e1af-4281-a96b-23a03f1a31c5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.535088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99939f61-e1af-4281-a96b-23a03f1a31c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.557872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-99939f61-e1af-4281-a96b-23a03f1a31c5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:34.559107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-99939f61-e1af-4281-a96b-23a03f1a31c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:34.631117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1091/2196] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:34.633108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701abe-7b56-4f97-af8a-f5f2674c572b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.633422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701abe-7b56-4f97-af8a-f5f2674c572b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.633786 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701abe-7b56-4f97-af8a-f5f2674c572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.654216 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d0701abe-7b56-4f97-af8a-f5f2674c572b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:34.655430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0701abe-7b56-4f97-af8a-f5f2674c572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:34.669358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1106/2197] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:34.670520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99939f61-e1af-4281-a96b-23a03f1a31c5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:34.683742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99939f61-e1af-4281-a96b-23a03f1a31c5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:34.689872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:34.690880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.691360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.691807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.692668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:34.693137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:34.694942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:34.725562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1092/2198] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:34.729970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0701abe-7b56-4f97-af8a-f5f2674c572b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:34.739660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0701abe-7b56-4f97-af8a-f5f2674c572b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:34.745089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:34.745990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.746442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.746863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.748162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:34.751178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:34.785316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1107/2199] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:34 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:34.787542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:34.797926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04bad-e78e-4b4a-a55c-0bfa34f188a3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:34.855806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:34.856444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.856730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.857007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.857829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:34.859700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:34.881788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1093/2200] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:34 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:34.886256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:34.897391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080146c-588a-45d8-83e5-e2071d02ecd1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:34.903144 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:34.903772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.904052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.904321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.905018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:34.906696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:34.917195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1108/2201] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:34.922187 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:34.927802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:34.932800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763da2b-4f6a-4315-86d2-6c4218f7d294 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:34.938930 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f9238-8f2e-4343-93d0-d186e031d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:34.939561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f9238-8f2e-4343-93d0-d186e031d916 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.939844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f9238-8f2e-4343-93d0-d186e031d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.940121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f9238-8f2e-4343-93d0-d186e031d916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.940876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f9238-8f2e-4343-93d0-d186e031d916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:34.942838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f9238-8f2e-4343-93d0-d186e031d916 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:34.954339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1094/2202] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:34.958958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:34.968763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddc088-46d3-44cb-bcfa-4ec24b06ed4c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:34.973821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:34.974906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:34.974906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:34.975123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] PATH_INFO: `/v3/projects/9e7fb81ed9fe4d568c291b885ed2e4fc/users/431a4f5526cc484485a23a5e288957f4/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:34.990703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7fb81ed9fe4d568c291b885ed2e4fc, user_id=431a4f5526cc484485a23a5e288957f4, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:34.993371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:35.007896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1109/2203] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:34 2022] PUT /identity/v3/projects/9e7fb81ed9fe4d568c291b885ed2e4fc/users/431a4f5526cc484485a23a5e288957f4/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:35.021329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132f4a0-da96-4beb-a8ea-d791ff6ba177 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:35.021658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132f4a0-da96-4beb-a8ea-d791ff6ba177 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:35.021964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132f4a0-da96-4beb-a8ea-d791ff6ba177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:35.049232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7132f4a0-da96-4beb-a8ea-d791ff6ba177 None None] MFA Rules not processed for user `431a4f5526cc484485a23a5e288957f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:35.050462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7132f4a0-da96-4beb-a8ea-d791ff6ba177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:35.116585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1095/2204] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:35.128752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:35.130741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:35.145240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:35.191448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114cadf-8e86-45f2-81ce-0bd834c3c719 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:35.195231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:35.195852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:35.196136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:35.196401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:35.204860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:35.206337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:35.215702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1110/2205] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:39.144037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132f4a0-da96-4beb-a8ea-d791ff6ba177 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:39.153939 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132f4a0-da96-4beb-a8ea-d791ff6ba177 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:39.157812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa50cb-217e-4a58-bd0c-041774ef29b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:39.158422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa50cb-217e-4a58-bd0c-041774ef29b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:39.158687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa50cb-217e-4a58-bd0c-041774ef29b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:39.158969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa50cb-217e-4a58-bd0c-041774ef29b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:39.160837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-49aa50cb-217e-4a58-bd0c-041774ef29b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:39.226692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa50cb-217e-4a58-bd0c-041774ef29b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:39.228137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa50cb-217e-4a58-bd0c-041774ef29b4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:39.238141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1096/2206] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:42.493465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:42.495247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:42.585364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7376-7aad-4a31-8f36-f7c24b086931 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:42.596959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:42.598268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:42.598793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:42.599072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] PATH_INFO: `/v3/users/d0bf92e49f394601beee0d550ed093d4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:42.600530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bf92e49f394601beee0d550ed093d4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:42.604506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:42.668134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bf92e49f394601beee0d550ed093d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:42.678001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bf92e49f394601beee0d550ed093d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:42.687146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bf92e49f394601beee0d550ed093d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:42.705780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bf92e49f394601beee0d550ed093d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:42.707159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bf92e49f394601beee0d550ed093d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:42.713478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1111/2207] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:42 2022] DELETE /identity/v3/users/d0bf92e49f394601beee0d550ed093d4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:42.718348 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:42.718811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:42.718896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:42.740351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:42.741644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:42.804184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1097/2208] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:42.814063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:42.815538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:42.851408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:42.876127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d8f09-07a0-4340-ad33-f0238c4028e2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:42.879894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986340-6824-4c51-af4a-40dddc7c2358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:42.880747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986340-6824-4c51-af4a-40dddc7c2358 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:42.881033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986340-6824-4c51-af4a-40dddc7c2358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:42.881337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986340-6824-4c51-af4a-40dddc7c2358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:42.891553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986340-6824-4c51-af4a-40dddc7c2358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:42.893083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986340-6824-4c51-af4a-40dddc7c2358 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:42.902620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1112/2209] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:43.660439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:43.662285 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:43.674932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0914b-bc23-49cd-b558-fb3d8b856027 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:43.680201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:43.680859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:43.681298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:43.681585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] PATH_INFO: `/v3/projects/edd69fdb0456488ea55e4f0300c7c71c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:43.682814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd69fdb0456488ea55e4f0300c7c71c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:43.685007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:43.698252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:43.761599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd69fdb0456488ea55e4f0300c7c71c', 'request_id': 'req-67244245-22d5-41e8-8a5b-c866dc624b59'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:43.770144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd69fdb0456488ea55e4f0300c7c71c', 'request_id': 'req-67244245-22d5-41e8-8a5b-c866dc624b59'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:43.780076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd69fdb0456488ea55e4f0300c7c71c', 'request_id': 'req-67244245-22d5-41e8-8a5b-c866dc624b59'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:43.795431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] The token cache is being invalidate because project edd69fdb0456488ea55e4f0300c7c71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:43.795911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:43.796801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67244245-22d5-41e8-8a5b-c866dc624b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:43.802584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1098/2210] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:43 2022] DELETE /identity/v3/projects/edd69fdb0456488ea55e4f0300c7c71c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:43.804334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646c74f-39bb-4ba2-8a2d-a7decc13fb52 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:43.804867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646c74f-39bb-4ba2-8a2d-a7decc13fb52 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:43.805024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646c74f-39bb-4ba2-8a2d-a7decc13fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:43.826382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2646c74f-39bb-4ba2-8a2d-a7decc13fb52 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:43.827714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2646c74f-39bb-4ba2-8a2d-a7decc13fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:43.891189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1113/2211] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:43.899853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9d29f-cecd-4737-9990-d2c3bb6c08b8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:43.900438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9d29f-cecd-4737-9990-d2c3bb6c08b8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:43.900768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9d29f-cecd-4737-9990-d2c3bb6c08b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:43.922583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8ee9d29f-cecd-4737-9990-d2c3bb6c08b8 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:43.923958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8ee9d29f-cecd-4737-9990-d2c3bb6c08b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:43.937328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1099/2212] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:43.941267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646c74f-39bb-4ba2-8a2d-a7decc13fb52 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:43.953986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646c74f-39bb-4ba2-8a2d-a7decc13fb52 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:43.960070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:43.960694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:43.961300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:43.961595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:43.962348 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:43.962727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:43.964424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:43.988059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1114/2213] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:43.996478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9d29f-cecd-4737-9990-d2c3bb6c08b8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:44.010910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9d29f-cecd-4737-9990-d2c3bb6c08b8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:44.016771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:44.017452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:44.017732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:44.018004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:44.019037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:44.021425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:44.080495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1100/2214] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:43 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:44.082381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:44.094340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387dfa-9d28-43db-a33f-ec2049c73074 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:44.185390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:44.186186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:44.186542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:44.186881 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:44.187877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:44.190099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:44.217670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1115/2215] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:44 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:44.219648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:44.232245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f37c-15ce-4a49-89fc-b5f7003826d0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:44.249877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:44.250924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:44.251215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:44.251488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:44.252210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:44.256643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:44.280440 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1101/2216] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:44.284512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:44.296308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cb519-ecea-4e0e-b8c4-25fdf4aced32 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:44.301995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947d50-fd05-4ecd-9359-9a3a917d889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:44.302699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947d50-fd05-4ecd-9359-9a3a917d889e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:44.303237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947d50-fd05-4ecd-9359-9a3a917d889e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:44.303719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947d50-fd05-4ecd-9359-9a3a917d889e admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:44.304459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947d50-fd05-4ecd-9359-9a3a917d889e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:44.306970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947d50-fd05-4ecd-9359-9a3a917d889e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:44.321501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1116/2217] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:44.325473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:44.342384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f09be-8c48-4e76-a9dc-bff6d5e2f39c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:44.347401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:44.351057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:44.351337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:44.351787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] PATH_INFO: `/v3/projects/0736a813c3a0408eb8ed6ab6fa439b84/users/97d1a65fa0414207bf8f2d4734219fe7/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:44.377063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0736a813c3a0408eb8ed6ab6fa439b84, user_id=97d1a65fa0414207bf8f2d4734219fe7, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:44.381165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:44.402345 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1102/2218] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:44 2022] PUT /identity/v3/projects/0736a813c3a0408eb8ed6ab6fa439b84/users/97d1a65fa0414207bf8f2d4734219fe7/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:44.416192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f86a3-ec98-4ac6-a0d7-c3a6b8285288 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:44.416528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f86a3-ec98-4ac6-a0d7-c3a6b8285288 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:44.416798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f86a3-ec98-4ac6-a0d7-c3a6b8285288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:44.450769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cb7f86a3-ec98-4ac6-a0d7-c3a6b8285288 None None] MFA Rules not processed for user `97d1a65fa0414207bf8f2d4734219fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:44.452277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cb7f86a3-ec98-4ac6-a0d7-c3a6b8285288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:44.490497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:44.537444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1117/2219] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:44.550659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:44.552571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:44.630582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2478-04fd-4f1e-9071-7b60ce865496 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:44.635378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:44.636029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:44.636315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:44.636594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:44.646831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:44.648337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:44.658473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1103/2220] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:45.888169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fc78-194c-47da-a9a3-7664e7429998 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:45.888667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fc78-194c-47da-a9a3-7664e7429998 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:45.888782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fc78-194c-47da-a9a3-7664e7429998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:45.909313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f110fc78-194c-47da-a9a3-7664e7429998 None None] MFA Rules not processed for user `3a893bdd4583472e96dbeec186542061`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:45.910547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f110fc78-194c-47da-a9a3-7664e7429998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:45.967994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1118/2221] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:46.350705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:46.352344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:46.412314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:46.440881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06319d3-72d2-49d6-a63d-564c747f72d9 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:46.446687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:46.447599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:46.448055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:46.448440 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] PATH_INFO: `/v3/users/72c35ee7dad249439f6e4af76582b377` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:46.450125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c35ee7dad249439f6e4af76582b377)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:46.451810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:46.553788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c35ee7dad249439f6e4af76582b377'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:46.569894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c35ee7dad249439f6e4af76582b377'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:46.590405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c35ee7dad249439f6e4af76582b377'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:46.600427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c35ee7dad249439f6e4af76582b377'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:46.601333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c35ee7dad249439f6e4af76582b377'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:46.631131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1104/2222] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:46 2022] DELETE /identity/v3/users/72c35ee7dad249439f6e4af76582b377 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:46.632671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:46.632984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:46.633267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:46.657030 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:46.658406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:46.782188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1119/2223] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:46.783667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:46.785161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:46.925707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3024-5c82-457d-af19-6ea3aab4f919 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:46.933111 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:46.934093 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:46.934606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:46.935088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:46.955167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:46.957314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:46.969708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1105/2224] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:47.359863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:47.361424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:47.376321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c73f8a-893e-4443-9e15-0e0a23845dbc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:47.382343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:47.383266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:47.383629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:47.383914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] PATH_INFO: `/v3/projects/1d0e713805ec4f7782e3eec683f5618e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:47.385371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d0e713805ec4f7782e3eec683f5618e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:47.387416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:47.418334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:47.419733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:47.434942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae128-234f-43b5-a303-a7c1f9474407 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:47.440191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:47.441201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:47.441664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:47.442011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] PATH_INFO: `/v3/users/35725724ab3d4148858c7f9cded65484` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:47.443845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35725724ab3d4148858c7f9cded65484)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:47.445691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:47.454104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d0e713805ec4f7782e3eec683f5618e', 'request_id': 'req-6c431c33-b2b3-4077-92a5-9624a5a2d46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.462976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d0e713805ec4f7782e3eec683f5618e', 'request_id': 'req-6c431c33-b2b3-4077-92a5-9624a5a2d46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.468651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d0e713805ec4f7782e3eec683f5618e', 'request_id': 'req-6c431c33-b2b3-4077-92a5-9624a5a2d46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.477206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:47.482479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] The token cache is being invalidate because project 1d0e713805ec4f7782e3eec683f5618e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:47.482994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.483725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.485525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1120/2225] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:47 2022] DELETE /identity/v3/projects/1d0e713805ec4f7782e3eec683f5618e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:47.490048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:47.491382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:47.499324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35725724ab3d4148858c7f9cded65484'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.508470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35725724ab3d4148858c7f9cded65484'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.509755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:47.524855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35725724ab3d4148858c7f9cded65484'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.532568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35725724ab3d4148858c7f9cded65484'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.533268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35725724ab3d4148858c7f9cded65484'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.539412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1106/2226] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:47 2022] DELETE /identity/v3/users/35725724ab3d4148858c7f9cded65484 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:47.556752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c431c33-b2b3-4077-92a5-9624a5a2d46f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:47.620793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:47.621504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:47.621785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:47.622059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] PATH_INFO: `/v3/users/09d52dcd4530478c8731ad01040065b8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:47.623565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d52dcd4530478c8731ad01040065b8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:47.625614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:47.679637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d52dcd4530478c8731ad01040065b8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.686623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d52dcd4530478c8731ad01040065b8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.694887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d52dcd4530478c8731ad01040065b8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.709530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d52dcd4530478c8731ad01040065b8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.710356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57364a7d-8f20-4ed1-bd52-f3d3df68ca76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d52dcd4530478c8731ad01040065b8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.716985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1121/2227] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:47 2022] DELETE /identity/v3/users/09d52dcd4530478c8731ad01040065b8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:47.722827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:47.724305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:47.737651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4132b0-efaf-4ff7-bdb6-02f07963ade5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:47.798491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:47.799156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:47.799442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:47.799722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] PATH_INFO: `/v3/projects/964dba76d9704a47b4c48e55c9b0702f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:47.801110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=964dba76d9704a47b4c48e55c9b0702f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:47.803409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:47.855416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964dba76d9704a47b4c48e55c9b0702f', 'request_id': 'req-cf29075d-0968-41d0-b742-e597f3c551ae'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.862406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964dba76d9704a47b4c48e55c9b0702f', 'request_id': 'req-cf29075d-0968-41d0-b742-e597f3c551ae'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.873152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964dba76d9704a47b4c48e55c9b0702f', 'request_id': 'req-cf29075d-0968-41d0-b742-e597f3c551ae'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.887558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] The token cache is being invalidate because project 964dba76d9704a47b4c48e55c9b0702f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:47.887858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.888515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf29075d-0968-41d0-b742-e597f3c551ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:47.890368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1107/2228] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:47 2022] DELETE /identity/v3/projects/964dba76d9704a47b4c48e55c9b0702f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:47.895124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:47.895490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:47.895834 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:47.920838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:47.922177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:47.951693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:48.005626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1122/2229] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:48.013758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9613b-be79-44e6-80d5-5e2bebf312e2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.013943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9613b-be79-44e6-80d5-5e2bebf312e2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.014126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9613b-be79-44e6-80d5-5e2bebf312e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.026684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.028650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.048101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2af9613b-be79-44e6-80d5-5e2bebf312e2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:48.051392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2af9613b-be79-44e6-80d5-5e2bebf312e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.056244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8971a-38f2-4eed-a5e1-8eed52dcae0f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.061787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1108/2230] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:48.062401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.063924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.064221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.064501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] PATH_INFO: `/v3/projects/8479406d46a341eabfa4a7b88da0d808` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.065978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9613b-be79-44e6-80d5-5e2bebf312e2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.066409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8479406d46a341eabfa4a7b88da0d808)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.068671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.079146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9613b-be79-44e6-80d5-5e2bebf312e2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.086703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.087938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.088588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.089258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.090633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:48.091224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.092925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.113567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1109/2231] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:48.122579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.136610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0cb7-45a1-4a9f-acfc-93237774907a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.146697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8479406d46a341eabfa4a7b88da0d808', 'request_id': 'req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:48.160183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8479406d46a341eabfa4a7b88da0d808', 'request_id': 'req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:48.169221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8479406d46a341eabfa4a7b88da0d808', 'request_id': 'req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:48.183304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] The token cache is being invalidate because project 8479406d46a341eabfa4a7b88da0d808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:48.183767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:48.184455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95dac68a-99c2-4bef-b5e6-3b3f59acdbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:48.186023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1123/2232] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:48 2022] DELETE /identity/v3/projects/8479406d46a341eabfa4a7b88da0d808 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:48.191555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817e05-279c-47e3-9250-7633b7c3d133 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.191841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817e05-279c-47e3-9250-7633b7c3d133 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.192113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817e05-279c-47e3-9250-7633b7c3d133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.195531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:48.214621 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.215198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ef817e05-279c-47e3-9250-7633b7c3d133 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:48.215327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.215549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.215821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.216444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ef817e05-279c-47e3-9250-7633b7c3d133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.216580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.218527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.224598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1124/2233] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:48.232884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f50c2-9466-4ce5-b51c-465ac45d071d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.233171 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f50c2-9466-4ce5-b51c-465ac45d071d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.233612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f50c2-9466-4ce5-b51c-465ac45d071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.249069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1110/2234] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:48.254396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d02f50c2-9466-4ce5-b51c-465ac45d071d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:48.255639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d02f50c2-9466-4ce5-b51c-465ac45d071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.257352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.259041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.314249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1125/2235] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:48.318379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f50c2-9466-4ce5-b51c-465ac45d071d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.322518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48c208-74af-4d7b-933e-2c553ffd46db admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.327023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f50c2-9466-4ce5-b51c-465ac45d071d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.327483 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.328109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.328393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.328664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.329358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.331338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.332098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.332696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.332970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.333238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.334086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:48.334385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.336017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.347544 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1126/2236] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:48.351988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.353580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1111/2237] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:48.357247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.361525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e15c5b-59ee-44eb-9fd5-e5351595cc6a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.366188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.366725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.367003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.367215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab7f78-ed85-407b-b2cd-0d0e1180c52f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.367330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.367911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.369830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.371873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.372478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.372764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.373040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.373771 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.375351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.386969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1112/2238] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:48.391047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.399776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1127/2239] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:48.400822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff156-b946-4d88-b17f-b8dff6de2c9a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.403884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.413659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:48.460546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.461181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.461508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.461786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.462497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.464224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.466031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce344b31-f9b4-41ce-9e5c-73b853dd9b87 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.470712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.471398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.471677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.471949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.472746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.474750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.479131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1113/2240] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:48.484989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.493407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea8a3-4440-4ce6-86ec-b80a96858afb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.499611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c727-43d0-4029-96da-5b534a252bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.500293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c727-43d0-4029-96da-5b534a252bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.500575 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c727-43d0-4029-96da-5b534a252bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.500855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c727-43d0-4029-96da-5b534a252bc1 admin admin] PATH_INFO: `/v3/projects/6de3e51ede7c4d6182b528d698a68b4c/users/23df9992ac7b4e89ba4dddef5b7e14a2/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.501779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1128/2241] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:33:48.505775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.515399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2769fa7-19fe-4e41-8e56-aea28da6b18a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.520028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.520165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205c727-43d0-4029-96da-5b534a252bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de3e51ede7c4d6182b528d698a68b4c, user_id=23df9992ac7b4e89ba4dddef5b7e14a2, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.520643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.520940 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.521329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.522034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.523123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205c727-43d0-4029-96da-5b534a252bc1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.523740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.538234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1129/2242] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:48.538409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1114/2243] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:48 2022] PUT /identity/v3/projects/6de3e51ede7c4d6182b528d698a68b4c/users/23df9992ac7b4e89ba4dddef5b7e14a2/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:48.540710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.541212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dd2b3-ffd7-4ff5-a518-24d96fb9dfbd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.541556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dd2b3-ffd7-4ff5-a518-24d96fb9dfbd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.541842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dd2b3-ffd7-4ff5-a518-24d96fb9dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.550893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d673e-06b2-4fa3-9942-e8864eab2251 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.560101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-649dd2b3-ffd7-4ff5-a518-24d96fb9dfbd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:48.561397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-649dd2b3-ffd7-4ff5-a518-24d96fb9dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.573901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:48.608430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.609058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.609372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.609650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.610351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.611977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.621418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1115/2244] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:48.622095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1130/2245] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:48.630623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dd2b3-ffd7-4ff5-a518-24d96fb9dfbd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.631152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.632867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.640583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dd2b3-ffd7-4ff5-a518-24d96fb9dfbd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.645412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5566eec-a76e-4be9-9a10-9a3d56653fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.646079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566eec-a76e-4be9-9a10-9a3d56653fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.646358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566eec-a76e-4be9-9a10-9a3d56653fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.646693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566eec-a76e-4be9-9a10-9a3d56653fdf admin admin] PATH_INFO: `/v3/projects/45edd7c232294b18984ba80ac0e6ad46/users/cb9ae5c2583d48e894b4bac75f541d11/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.663617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5566eec-a76e-4be9-9a10-9a3d56653fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=45edd7c232294b18984ba80ac0e6ad46, user_id=cb9ae5c2583d48e894b4bac75f541d11, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.666058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5566eec-a76e-4be9-9a10-9a3d56653fdf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.681606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1116/2246] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:48 2022] PUT /identity/v3/projects/45edd7c232294b18984ba80ac0e6ad46/users/cb9ae5c2583d48e894b4bac75f541d11/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:48.694249 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.694598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.694943 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.709307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eedb6-62ca-4f63-b7c2-b0fe6d62ad89 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.737132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] MFA Rules not processed for user `cb9ae5c2583d48e894b4bac75f541d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:48.738483 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.754305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:48.766776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.767410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.767691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.767967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.804307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1117/2247] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:48.815960 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.817369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:48.828509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.830081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.840484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1131/2248] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:48.875714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f14fcc-cf83-4549-972a-cd6246e1e388 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.879370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecf536-3e19-4451-beb1-92a5d7de7e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.879957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecf536-3e19-4451-beb1-92a5d7de7e00 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.880239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecf536-3e19-4451-beb1-92a5d7de7e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.880613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecf536-3e19-4451-beb1-92a5d7de7e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.889647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecf536-3e19-4451-beb1-92a5d7de7e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.891130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecf536-3e19-4451-beb1-92a5d7de7e00 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:48.900540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1118/2249] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:48.920068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:48.930558 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39b59a-6e4f-4741-99ff-4ad8d1dfa331 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:48.935648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:48.936317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:48.936695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:48.936964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] PATH_INFO: `/v3/users/cb9ae5c2583d48e894b4bac75f541d11` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:48.938203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9ae5c2583d48e894b4bac75f541d11)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:48.940130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:49.013633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9ae5c2583d48e894b4bac75f541d11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.023562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9ae5c2583d48e894b4bac75f541d11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.033954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9ae5c2583d48e894b4bac75f541d11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.054162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9ae5c2583d48e894b4bac75f541d11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.054934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9ae5c2583d48e894b4bac75f541d11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.065268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1132/2250] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:48 2022] DELETE /identity/v3/users/cb9ae5c2583d48e894b4bac75f541d11 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:49.066545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:49.066841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:49.067414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:49.090074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:49.091373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:49.113463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:49.166827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1119/2251] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:49.179969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:49.181718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:49.260316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6c2ec-5cd6-427d-83a6-3229c2f9d6af admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:49.264068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891678a-ed7d-4682-a27f-d47dc92267e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:49.264703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891678a-ed7d-4682-a27f-d47dc92267e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:49.264987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891678a-ed7d-4682-a27f-d47dc92267e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:49.265243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891678a-ed7d-4682-a27f-d47dc92267e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:49.276456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891678a-ed7d-4682-a27f-d47dc92267e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:49.278056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891678a-ed7d-4682-a27f-d47dc92267e1 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:49.288959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1133/2252] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:49.730496 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:49.737119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:49.763310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10300e-48a8-4e36-98df-8abf6af4be59 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:49.769871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:49.770708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:49.771222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:49.771656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] PATH_INFO: `/v3/projects/45edd7c232294b18984ba80ac0e6ad46` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:49.773586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45edd7c232294b18984ba80ac0e6ad46)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:49.777060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:49.835051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45edd7c232294b18984ba80ac0e6ad46', 'request_id': 'req-117809ae-6123-4e47-b8cb-b1a253b75b8e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.842048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45edd7c232294b18984ba80ac0e6ad46', 'request_id': 'req-117809ae-6123-4e47-b8cb-b1a253b75b8e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.851553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45edd7c232294b18984ba80ac0e6ad46', 'request_id': 'req-117809ae-6123-4e47-b8cb-b1a253b75b8e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.865495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] The token cache is being invalidate because project 45edd7c232294b18984ba80ac0e6ad46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:49.865847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.866511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-117809ae-6123-4e47-b8cb-b1a253b75b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:49.868326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1120/2253] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:49 2022] DELETE /identity/v3/projects/45edd7c232294b18984ba80ac0e6ad46 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:33:49.873023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c514e62-f8f2-411f-910d-1e27d625b783 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:49.873507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c514e62-f8f2-411f-910d-1e27d625b783 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:49.873619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c514e62-f8f2-411f-910d-1e27d625b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:49.882811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:49.894603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7c514e62-f8f2-411f-910d-1e27d625b783 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:49.896494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7c514e62-f8f2-411f-910d-1e27d625b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:49.969471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1134/2254] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:49.977805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53a67-5d05-4e8c-ba57-8ec96bb094fc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:49.978139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53a67-5d05-4e8c-ba57-8ec96bb094fc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:49.978463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53a67-5d05-4e8c-ba57-8ec96bb094fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.002629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-73d53a67-5d05-4e8c-ba57-8ec96bb094fc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:50.003947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-73d53a67-5d05-4e8c-ba57-8ec96bb094fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:50.013773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1121/2255] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:50.019128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c514e62-f8f2-411f-910d-1e27d625b783 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.031445 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c514e62-f8f2-411f-910d-1e27d625b783 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.036553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.037231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.037564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.037839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.038645 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:50.039089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.041006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.059076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53a67-5d05-4e8c-ba57-8ec96bb094fc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.066437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1135/2256] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:50.070630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53a67-5d05-4e8c-ba57-8ec96bb094fc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.078848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.080294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.080713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.082072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.082454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.084975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.141333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1122/2257] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:50 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:50.145156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.156765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30a2e-b37e-4668-b9b5-b6742abe03f4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.227267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.227910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.228194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.228479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.229176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.231204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.265378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1136/2258] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:50 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:50.269726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.283104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860e77-9580-4335-9f40-0dc8be773816 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.288576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.289554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.289929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.290714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.291062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.292825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.305236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1123/2259] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:50.309162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.320379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d2223-c4d3-452e-998a-253afa98b703 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.326587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee7883-a4d1-43bc-9c96-487525add689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.327374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee7883-a4d1-43bc-9c96-487525add689 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.327660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee7883-a4d1-43bc-9c96-487525add689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.327936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee7883-a4d1-43bc-9c96-487525add689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.328644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee7883-a4d1-43bc-9c96-487525add689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.330316 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee7883-a4d1-43bc-9c96-487525add689 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.344421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1137/2260] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:33:50.350549 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.362909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f1a1-7ef1-4d7c-8064-a03a8a7d20ec admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.368661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.369491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.369878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.370258 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] PATH_INFO: `/v3/projects/bc6f507c459d46ff9d9a1fd1f7a8fbf1/users/07b6861424b341eeb81e9ff6f9e4b86b/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.393454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6f507c459d46ff9d9a1fd1f7a8fbf1, user_id=07b6861424b341eeb81e9ff6f9e4b86b, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.396321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.424009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1124/2261] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:50 2022] PUT /identity/v3/projects/bc6f507c459d46ff9d9a1fd1f7a8fbf1/users/07b6861424b341eeb81e9ff6f9e4b86b/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:50.433821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754591e-147c-4d7d-a917-019ec4ec93cd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.434108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754591e-147c-4d7d-a917-019ec4ec93cd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.434387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754591e-147c-4d7d-a917-019ec4ec93cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.485945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4754591e-147c-4d7d-a917-019ec4ec93cd None None] MFA Rules not processed for user `07b6861424b341eeb81e9ff6f9e4b86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:50.487864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4754591e-147c-4d7d-a917-019ec4ec93cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:50.607358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:50.617083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1138/2262] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:50.627921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.629866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:50.695337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:50.704332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79904432-088c-4196-8862-a5fa1ef6fcea admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.710215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05d92e-164c-4ae0-8a4e-ff7e06f17a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.711019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d92e-164c-4ae0-8a4e-ff7e06f17a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.711409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d92e-164c-4ae0-8a4e-ff7e06f17a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.711793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d92e-164c-4ae0-8a4e-ff7e06f17a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.723286 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05d92e-164c-4ae0-8a4e-ff7e06f17a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.724798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05d92e-164c-4ae0-8a4e-ff7e06f17a48 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.736010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1125/2263] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:50.763713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754591e-147c-4d7d-a917-019ec4ec93cd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:50.878840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754591e-147c-4d7d-a917-019ec4ec93cd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:50.886550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:50.887454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:50.887920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:50.889835 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] PATH_INFO: `/v3/users/07b6861424b341eeb81e9ff6f9e4b86b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:50.891699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b6861424b341eeb81e9ff6f9e4b86b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:50.893774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:50.957760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b6861424b341eeb81e9ff6f9e4b86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:50.967644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b6861424b341eeb81e9ff6f9e4b86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:50.978400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b6861424b341eeb81e9ff6f9e4b86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:50.991512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b6861424b341eeb81e9ff6f9e4b86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:50.992631 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b6861424b341eeb81e9ff6f9e4b86b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:51.000374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1139/2264] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:33:50 2022] DELETE /identity/v3/users/07b6861424b341eeb81e9ff6f9e4b86b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:51.005849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:51.006143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:51.007163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:51.026115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:51.027221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:51.090178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1126/2265] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:51.100091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:51.101593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:51.166555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5122bd-d149-4d17-a80e-68a2976313eb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:51.170284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e455c-d45b-48ab-b00f-8acf9893335d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:51.170908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e455c-d45b-48ab-b00f-8acf9893335d service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:51.171191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e455c-d45b-48ab-b00f-8acf9893335d service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:51.171466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e455c-d45b-48ab-b00f-8acf9893335d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:51.181663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e455c-d45b-48ab-b00f-8acf9893335d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:51.183143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e455c-d45b-48ab-b00f-8acf9893335d service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:51.193197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1140/2266] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:51.648687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:51.651373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:51.665664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9949d8c-7c87-49a6-a819-0ce602af8ff2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:51.670963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:51.671625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:51.671906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:51.672178 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] PATH_INFO: `/v3/projects/bc6f507c459d46ff9d9a1fd1f7a8fbf1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:51.673678 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6f507c459d46ff9d9a1fd1f7a8fbf1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:51.675539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:51.744865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6f507c459d46ff9d9a1fd1f7a8fbf1', 'request_id': 'req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:51.754341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6f507c459d46ff9d9a1fd1f7a8fbf1', 'request_id': 'req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:51.768376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6f507c459d46ff9d9a1fd1f7a8fbf1', 'request_id': 'req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:51.782810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] The token cache is being invalidate because project bc6f507c459d46ff9d9a1fd1f7a8fbf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:33:51.783389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:51.784361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7a1593d8-ad94-4a3a-9678-eac5df94a9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:33:51.786611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1127/2267] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:33:51 2022] DELETE /identity/v3/projects/bc6f507c459d46ff9d9a1fd1f7a8fbf1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:51.791540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dd3e-8f60-49ef-a590-4e08fe940033 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:51.792360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dd3e-8f60-49ef-a590-4e08fe940033 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:51.792777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dd3e-8f60-49ef-a590-4e08fe940033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:51.825378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4af0dd3e-8f60-49ef-a590-4e08fe940033 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:51.826632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4af0dd3e-8f60-49ef-a590-4e08fe940033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:51.848261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:51.908917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1141/2268] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:51.917871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f476-da55-4ff7-a707-45c41da11ec4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:51.917871 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f476-da55-4ff7-a707-45c41da11ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:51.921157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f476-da55-4ff7-a707-45c41da11ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:51.960083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e8e1f476-da55-4ff7-a707-45c41da11ec4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:51.960083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e8e1f476-da55-4ff7-a707-45c41da11ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:51.972983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1128/2269] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:51.976330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dd3e-8f60-49ef-a590-4e08fe940033 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:52.001463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dd3e-8f60-49ef-a590-4e08fe940033 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:52.009123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:52.010080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.010581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.011027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.011983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:33:52.012569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:52.015337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:52.047909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1f476-da55-4ff7-a707-45c41da11ec4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:52.054795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1142/2270] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:33:52.058891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1f476-da55-4ff7-a707-45c41da11ec4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:52.064042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:52.064688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.065096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.065425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.066116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:52.068526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:52.104702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1129/2271] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:33:52 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:52.109565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:52.122350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b142b-496c-4a65-96b1-92726056bf3d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:52.192215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:52.192627 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.192921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.193244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.193981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:52.196011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:52.227015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1143/2272] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:33:52 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:33:52.228561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:52.241491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8e0a-a7cc-4e51-b8a3-7f2139ab0d40 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:52.250708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:52.251370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.251662 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.252222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.253398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:52.254673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:52.270307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1130/2273] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:52.274226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:52.290579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971308b2-4012-429b-8e64-6c3079c1eba4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:52.296986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dd749-9549-4ae8-ba7c-3a9e4b45560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:52.297962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd749-9549-4ae8-ba7c-3a9e4b45560b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.298536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd749-9549-4ae8-ba7c-3a9e4b45560b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.300211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd749-9549-4ae8-ba7c-3a9e4b45560b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.300936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dd749-9549-4ae8-ba7c-3a9e4b45560b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:52.302732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dd749-9549-4ae8-ba7c-3a9e4b45560b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:52.319350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1144/2274] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:33:52.323491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:52.334255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892096-58dd-4a30-845d-832adbd09cd1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:52.339854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:52.340553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.340880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.341499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] PATH_INFO: `/v3/projects/03acdfb90d9641af9450affe8796690e/users/a546532f24d24f6b82f4c50eb3b10577/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.362703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03acdfb90d9641af9450affe8796690e, user_id=a546532f24d24f6b82f4c50eb3b10577, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:52.365904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:52.395548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1131/2275] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:33:52 2022] PUT /identity/v3/projects/03acdfb90d9641af9450affe8796690e/users/a546532f24d24f6b82f4c50eb3b10577/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:33:52.397537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff135-4bd8-420e-8476-ab3487102e27 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.397878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff135-4bd8-420e-8476-ab3487102e27 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.398178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff135-4bd8-420e-8476-ab3487102e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.429198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d0dff135-4bd8-420e-8476-ab3487102e27 None None] MFA Rules not processed for user `a546532f24d24f6b82f4c50eb3b10577`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:52.430490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0dff135-4bd8-420e-8476-ab3487102e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:52.507199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1145/2276] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:33:52.519834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:52.521863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:52.536351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:52.600041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f39fef-fa8d-4f13-9ff3-1e2e7dba9f30 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:52.604286 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:52.605795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:52.606353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:52.607734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:52.622780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:52.624411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:52.639444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1132/2277] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:33:54.066639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67537a4d-b4a1-4882-b438-c7ef7b8d97a8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:54.067161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67537a4d-b4a1-4882-b438-c7ef7b8d97a8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:54.067237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67537a4d-b4a1-4882-b438-c7ef7b8d97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:54.102923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-67537a4d-b4a1-4882-b438-c7ef7b8d97a8 None None] MFA Rules not processed for user `23df9992ac7b4e89ba4dddef5b7e14a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:54.104912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-67537a4d-b4a1-4882-b438-c7ef7b8d97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:54.112557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:54.195281 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1146/2278] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:33:54.206778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:33:54.208343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:54.326449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767acfbf-d4a3-4795-8ae2-cf4c001e803b service glance] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:33:54.336074 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:33:54.336940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:54.337350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:54.337717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:54.347356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:33:54.349135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:33:54.361552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1133/2279] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:33:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:33:56.213840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5831-81e4-4c11-a886-a30a0453c775 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:33:56.214380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5831-81e4-4c11-a886-a30a0453c775 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:33:56.214380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5831-81e4-4c11-a886-a30a0453c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:33:56.234741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c6ea5831-81e4-4c11-a886-a30a0453c775 None None] MFA Rules not processed for user `23df9992ac7b4e89ba4dddef5b7e14a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:33:56.241313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c6ea5831-81e4-4c11-a886-a30a0453c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:33:56.270231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1147/2280] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:33:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:34:04.356908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=56 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:06.229333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=27 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:25.664686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:25.666223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:25.738664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8c92-e407-4f6a-9531-628ee8ed1a81 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:25.743607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:25.744433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:25.744714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:25.744987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] PATH_INFO: `/v3/users/97d1a65fa0414207bf8f2d4734219fe7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:25.746365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d1a65fa0414207bf8f2d4734219fe7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:25.748469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:25.801367 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d1a65fa0414207bf8f2d4734219fe7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:25.809905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d1a65fa0414207bf8f2d4734219fe7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:25.831470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d1a65fa0414207bf8f2d4734219fe7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:25.838889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d1a65fa0414207bf8f2d4734219fe7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:25.839668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d1a65fa0414207bf8f2d4734219fe7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:25.846052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1134/2281] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:34:25 2022] DELETE /identity/v3/users/97d1a65fa0414207bf8f2d4734219fe7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:34:25.850873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:25.851400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:25.851511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:25.875052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:25.876369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:25.936260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1148/2282] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:34:25.948734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:25.951283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:26.024218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e79a-7299-4f03-a46e-a821b82f3de4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:26.031849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cbc99-bc8e-4c4e-8cb3-ed50a8bc6c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:26.032489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cbc99-bc8e-4c4e-8cb3-ed50a8bc6c3e service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.032800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cbc99-bc8e-4c4e-8cb3-ed50a8bc6c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.033078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cbc99-bc8e-4c4e-8cb3-ed50a8bc6c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.044590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cbc99-bc8e-4c4e-8cb3-ed50a8bc6c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:26.046914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cbc99-bc8e-4c4e-8cb3-ed50a8bc6c3e service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:26.060167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1135/2283] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:34:26.519619 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:26.521032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:26.535773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96240f3-abd0-4dbb-9ad3-ab7c33b272c8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:26.541222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:26.542132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.542795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.543269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] PATH_INFO: `/v3/projects/0736a813c3a0408eb8ed6ab6fa439b84` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.544821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0736a813c3a0408eb8ed6ab6fa439b84)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:26.547661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:26.615220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0736a813c3a0408eb8ed6ab6fa439b84', 'request_id': 'req-14521f00-31a3-4962-b1df-d85aa3feb1de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:26.623120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0736a813c3a0408eb8ed6ab6fa439b84', 'request_id': 'req-14521f00-31a3-4962-b1df-d85aa3feb1de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:26.629200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0736a813c3a0408eb8ed6ab6fa439b84', 'request_id': 'req-14521f00-31a3-4962-b1df-d85aa3feb1de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:26.640718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] The token cache is being invalidate because project 0736a813c3a0408eb8ed6ab6fa439b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:34:26.641009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:26.641784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-14521f00-31a3-4962-b1df-d85aa3feb1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:26.643540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1149/2284] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:34:26 2022] DELETE /identity/v3/projects/0736a813c3a0408eb8ed6ab6fa439b84 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:34:26.648727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4783-57dd-4fab-b736-9c1c5bb9b6f7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.649087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4783-57dd-4fab-b736-9c1c5bb9b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.649520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4783-57dd-4fab-b736-9c1c5bb9b6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.671110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-180a4783-57dd-4fab-b736-9c1c5bb9b6f7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:26.672339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-180a4783-57dd-4fab-b736-9c1c5bb9b6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:26.689403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:26.737499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1136/2285] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:34:26.745525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa147d7-ea9c-4c63-9eec-2afdcc4f923b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.745883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa147d7-ea9c-4c63-9eec-2afdcc4f923b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.746168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa147d7-ea9c-4c63-9eec-2afdcc4f923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.766247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4aa147d7-ea9c-4c63-9eec-2afdcc4f923b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:26.767611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4aa147d7-ea9c-4c63-9eec-2afdcc4f923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:26.775738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1150/2286] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:34:26.780091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4783-57dd-4fab-b736-9c1c5bb9b6f7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:26.789989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4783-57dd-4fab-b736-9c1c5bb9b6f7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:26.794594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:26.795208 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.795493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.795768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.796471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:34:26.796779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:26.798468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:26.810002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1137/2287] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:34:26.814429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa147d7-ea9c-4c63-9eec-2afdcc4f923b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:26.824988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa147d7-ea9c-4c63-9eec-2afdcc4f923b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:26.830352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:26.831015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.831661 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.831935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.832617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:26.834591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:26.869460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1151/2288] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:34:26 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:34:26.872889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:26.884257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925180-fcaf-4a80-8f3e-5525c1d3b921 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:26.944488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:26.945106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.945449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.945729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.946400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:26.948328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:26.971997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1138/2289] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:34:26 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:34:26.978427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:26.989707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92739df8-dc92-48e7-a762-6a2807882251 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:26.994907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:26.995589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:26.995875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:26.996258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:26.996967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:26.998700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:27.013067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1152/2290] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:34:27.014301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:27.025194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951b06-24a3-476f-9dfa-e50af43479a1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:27.030867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c479e8-91f5-4f34-8649-b653f1e975e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:27.031482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c479e8-91f5-4f34-8649-b653f1e975e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:27.031768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c479e8-91f5-4f34-8649-b653f1e975e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:27.032044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c479e8-91f5-4f34-8649-b653f1e975e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:27.032767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c479e8-91f5-4f34-8649-b653f1e975e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:27.034569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c479e8-91f5-4f34-8649-b653f1e975e1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:27.047246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1139/2291] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:34:27.051523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:27.066359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e622-d7a7-4437-be35-2cd90bca7911 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:27.071411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:27.072092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:27.072361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:27.072636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] PATH_INFO: `/v3/projects/ba081e6d68e3474db0be4d577294d333/users/fd5463700f2e4d26b84ebfb65064686d/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:27.094524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba081e6d68e3474db0be4d577294d333, user_id=fd5463700f2e4d26b84ebfb65064686d, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:27.097241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:27.113703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1153/2292] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:34:27 2022] PUT /identity/v3/projects/ba081e6d68e3474db0be4d577294d333/users/fd5463700f2e4d26b84ebfb65064686d/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:34:27.119020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539d81-1f33-4bc7-9498-a52f6b319418 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:27.119374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539d81-1f33-4bc7-9498-a52f6b319418 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:27.119931 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539d81-1f33-4bc7-9498-a52f6b319418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:27.141677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-02539d81-1f33-4bc7-9498-a52f6b319418 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:27.142971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-02539d81-1f33-4bc7-9498-a52f6b319418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:27.207748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1140/2293] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:34:27.219899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:27.222365 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:27.248975 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:27.295233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ddeff-c8b0-4f54-96a0-65f72151a0c5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:27.300065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:27.300700 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:27.300983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:27.301260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:27.311720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:27.313191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:27.323854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1154/2294] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:34:31.923021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6403e5-c00d-47ab-b6b0-9fe19fb113e1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:31.923555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6403e5-c00d-47ab-b6b0-9fe19fb113e1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:31.923646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6403e5-c00d-47ab-b6b0-9fe19fb113e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:31.955482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cb6403e5-c00d-47ab-b6b0-9fe19fb113e1 None None] MFA Rules not processed for user `fd5463700f2e4d26b84ebfb65064686d`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:31.957231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cb6403e5-c00d-47ab-b6b0-9fe19fb113e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:31.975849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:32.029891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1141/2295] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:34:32.034463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:32.044369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c196-cffa-41cc-8f73-8b79b4f2dd1c service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:32.048938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:32.049589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:32.049869 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:32.050138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:32.050812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:32.052735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:32.086817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1155/2296] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:34:32 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:34:32.091246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6403e5-c00d-47ab-b6b0-9fe19fb113e1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:32.105852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6403e5-c00d-47ab-b6b0-9fe19fb113e1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:32.174319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:32.174964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:32.175245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:32.175519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:32.176202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:32.178358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:32.203094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1142/2297] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:34:32 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:34:32.207701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:32.218417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5edd6-e51e-4b0a-80e7-0ef4f21073d3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:32.223248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:32.223884 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:32.224165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:32.224438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:32.225149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:32.226812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:32.241862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1156/2298] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:34:32.243440 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:32.254539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789be73-04e7-4e59-94b3-d6e8d6069e24 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:32.259325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:32.260012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:32.260297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:32.260612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] PATH_INFO: `/v3/projects/9d61db9b0524467182b30bb3561a5b56/users/a40f93d87d9646ffa70df9901b029b9b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:32.277385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d61db9b0524467182b30bb3561a5b56, user_id=a40f93d87d9646ffa70df9901b029b9b, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:32.280143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:32.294636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1143/2299] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:34:32 2022] PUT /identity/v3/projects/9d61db9b0524467182b30bb3561a5b56/users/a40f93d87d9646ffa70df9901b029b9b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:34:32.298707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:32.309266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb671-8969-4397-9f1b-4c8fc747002c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:32.367037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd1408-388f-40ee-b728-d9f3c620149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:32.367685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1408-388f-40ee-b728-d9f3c620149a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:32.367969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1408-388f-40ee-b728-d9f3c620149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:32.368244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1408-388f-40ee-b728-d9f3c620149a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:32.368959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd1408-388f-40ee-b728-d9f3c620149a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:32.370637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd1408-388f-40ee-b728-d9f3c620149a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:32.381380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1157/2300] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:34:32.385928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:32.396839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48739f-e97b-4c6a-9a5a-64db490d56e4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:32.401530 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:32.402247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:32.402657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:32.402938 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] PATH_INFO: `/v3/projects/9d61db9b0524467182b30bb3561a5b56/users/a40f93d87d9646ffa70df9901b029b9b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:32.404894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d61db9b0524467182b30bb3561a5b56, user_id=a40f93d87d9646ffa70df9901b029b9b, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:32.407711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:32.419402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1144/2301] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:34:32 2022] PUT /identity/v3/projects/9d61db9b0524467182b30bb3561a5b56/users/a40f93d87d9646ffa70df9901b029b9b/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:34:38.750896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6ebc2-9559-4e03-9b2f-005f1378cddd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:38.751411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6ebc2-9559-4e03-9b2f-005f1378cddd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:38.751620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6ebc2-9559-4e03-9b2f-005f1378cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:38.783997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-10d6ebc2-9559-4e03-9b2f-005f1378cddd None None] MFA Rules not processed for user `a40f93d87d9646ffa70df9901b029b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:38.786128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-10d6ebc2-9559-4e03-9b2f-005f1378cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:38.883865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1158/2302] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:34:38.898078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:38.899907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:38.985165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900611e-0a8c-4335-8234-a6358aa14667 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:38.991478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707ed1-e2c3-4691-925d-ee3559d37b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:38.992378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707ed1-e2c3-4691-925d-ee3559d37b6e service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:38.992553 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707ed1-e2c3-4691-925d-ee3559d37b6e service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:38.993007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707ed1-e2c3-4691-925d-ee3559d37b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:38.999596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:39.060712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707ed1-e2c3-4691-925d-ee3559d37b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:39.062291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707ed1-e2c3-4691-925d-ee3559d37b6e service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:39.073671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1145/2303] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:34:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:34:40.872787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:40.873452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:40.873545 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:40.893938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] MFA Rules not processed for user `fd5463700f2e4d26b84ebfb65064686d`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:40.895237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:40.917475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1159/2304] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:34:48.401736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:48.402250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:48.402250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:48.422638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:48.423978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:48.483627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1146/2305] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:34:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:34:48.537129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:48.539751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:48.548752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:48.616733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e991-38b7-4e35-8970-1f184f48396e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:48.622567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8740b-abd7-418a-95af-7d4c888135dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:48.623528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8740b-abd7-418a-95af-7d4c888135dd service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:48.623689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8740b-abd7-418a-95af-7d4c888135dd service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:48.624025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8740b-abd7-418a-95af-7d4c888135dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:48.636252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8740b-abd7-418a-95af-7d4c888135dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:48.637944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8740b-abd7-418a-95af-7d4c888135dd service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:48.646923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1160/2306] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:34:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:34:58.476491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=49 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:58.497610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:58.503075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:58.598730 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d0678-f52c-4fd8-a920-b10409e71550 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:58.603702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:58.604419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:58.604747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:58.605046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] PATH_INFO: `/v3/users/431a4f5526cc484485a23a5e288957f4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:58.606628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=431a4f5526cc484485a23a5e288957f4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:58.608845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:58.643737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=30 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:58.688582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431a4f5526cc484485a23a5e288957f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:58.704838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431a4f5526cc484485a23a5e288957f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:58.728459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431a4f5526cc484485a23a5e288957f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:58.740067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431a4f5526cc484485a23a5e288957f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:58.741042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431a4f5526cc484485a23a5e288957f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:58.748844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1147/2307] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:34:58 2022] DELETE /identity/v3/users/431a4f5526cc484485a23a5e288957f4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:34:58.754568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:58.754970 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:58.755372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:58.778457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:58.779935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:58.890699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1161/2308] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:34:58.901225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:58.903405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:59.055656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b16d6-c2b9-4d94-a500-2246532ba88f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:59.059741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d5da5-acc8-4e63-a5c1-acc95d7b451b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:59.060752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5da5-acc8-4e63-a5c1-acc95d7b451b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:59.061247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5da5-acc8-4e63-a5c1-acc95d7b451b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:59.061753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5da5-acc8-4e63-a5c1-acc95d7b451b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:59.079781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d5da5-acc8-4e63-a5c1-acc95d7b451b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:59.081826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d5da5-acc8-4e63-a5c1-acc95d7b451b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:59.093010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1148/2309] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:34:59.436579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:59.438459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:59.460120 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fff9a-a7bb-48a6-bc81-9b1d5779a646 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:59.472027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:59.472967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:59.473266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:59.473568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] PATH_INFO: `/v3/projects/9e7fb81ed9fe4d568c291b885ed2e4fc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:59.474878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7fb81ed9fe4d568c291b885ed2e4fc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:59.477027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:59.540070 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7fb81ed9fe4d568c291b885ed2e4fc', 'request_id': 'req-95c12541-111c-4ffa-9951-227ca0255dfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:59.550450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7fb81ed9fe4d568c291b885ed2e4fc', 'request_id': 'req-95c12541-111c-4ffa-9951-227ca0255dfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:59.558405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7fb81ed9fe4d568c291b885ed2e4fc', 'request_id': 'req-95c12541-111c-4ffa-9951-227ca0255dfc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:59.571378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] The token cache is being invalidate because project 9e7fb81ed9fe4d568c291b885ed2e4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:34:59.571670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:59.572331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-95c12541-111c-4ffa-9951-227ca0255dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:34:59.577533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1162/2310] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:34:59 2022] DELETE /identity/v3/projects/9e7fb81ed9fe4d568c291b885ed2e4fc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:34:59.579242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe900-013f-4624-b263-99a320303fa3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:59.579862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe900-013f-4624-b263-99a320303fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:59.579862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe900-013f-4624-b263-99a320303fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:59.602636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-943fe900-013f-4624-b263-99a320303fa3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:59.603815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-943fe900-013f-4624-b263-99a320303fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:59.625534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:59.683064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1149/2311] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:34:59.692376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bd44c-7683-419a-9773-d056290a0d2f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:59.692995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bd44c-7683-419a-9773-d056290a0d2f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:59.692995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bd44c-7683-419a-9773-d056290a0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:59.747712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a88bd44c-7683-419a-9773-d056290a0d2f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:34:59.749431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a88bd44c-7683-419a-9773-d056290a0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:34:59.760256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1163/2312] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:34:59.765054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fe900-013f-4624-b263-99a320303fa3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:59.777060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fe900-013f-4624-b263-99a320303fa3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:59.782197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:59.782921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:59.783236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:59.783533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:59.784484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:34:59.784797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:59.786696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:59.807940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1150/2313] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:34:59.809322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bd44c-7683-419a-9773-d056290a0d2f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:59.820503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bd44c-7683-419a-9773-d056290a0d2f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:59.829010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:59.830505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:59.831230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:59.831833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:59.833273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:59.837159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:34:59.881503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1164/2314] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:34:59 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:34:59.885631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:34:59.898604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574972e-786f-4ccb-9bcb-5ec392d9df16 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:34:59.984639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:34:59.985362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:34:59.985686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:34:59.985967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:34:59.986700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:34:59.988753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:00.031493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1151/2315] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:34:59 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:35:00.031618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:00.047998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525299-2029-4146-8bd8-808e59d038a8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:00.056788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:00.057471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:00.057756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:00.058033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:00.058764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:00.060413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:00.072801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1165/2316] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:35:00.077564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:00.091519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4ffd-5ce9-4ffa-bc73-2668ac60500c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:00.097207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c057fb-696a-4715-84ce-cf29374d83d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:00.100068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c057fb-696a-4715-84ce-cf29374d83d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:00.100068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c057fb-696a-4715-84ce-cf29374d83d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:00.100068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c057fb-696a-4715-84ce-cf29374d83d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:00.100068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c057fb-696a-4715-84ce-cf29374d83d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:00.101501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c057fb-696a-4715-84ce-cf29374d83d9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:00.122453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:00.127934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1152/2317] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:35:00.143914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe11386-725c-4e41-b1f3-d6770de32ac7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:00.152487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:00.153683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:00.154291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:00.154900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] PATH_INFO: `/v3/projects/837c36665fa2423580371cadf33db911/users/bc5dde72e9424e688a69b819fab7424e/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:00.172893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837c36665fa2423580371cadf33db911, user_id=bc5dde72e9424e688a69b819fab7424e, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:00.175718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:00.191758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1166/2318] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:35:00 2022] PUT /identity/v3/projects/837c36665fa2423580371cadf33db911/users/bc5dde72e9424e688a69b819fab7424e/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:00.197358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e95aa-a97b-457e-b996-59751fb384fc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:00.197660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e95aa-a97b-457e-b996-59751fb384fc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:00.197949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e95aa-a97b-457e-b996-59751fb384fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:00.219586 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-411e95aa-a97b-457e-b996-59751fb384fc None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:00.221149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-411e95aa-a97b-457e-b996-59751fb384fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:00.282948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1153/2319] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:00.292752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:00.294638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:00.317396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:00.353381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c072d8c-32fb-46ea-9e4a-f1720a146664 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:00.357405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:00.358027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:00.358306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:00.358587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:00.368461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:00.369983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:00.379767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1167/2320] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:35:04.240608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d359-36a5-4a42-aa6d-f48cc384e39e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:04.240608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d359-36a5-4a42-aa6d-f48cc384e39e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:04.240608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d359-36a5-4a42-aa6d-f48cc384e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:04.276849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3cd9d359-36a5-4a42-aa6d-f48cc384e39e None None] MFA Rules not processed for user `bc5dde72e9424e688a69b819fab7424e`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:04.278100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3cd9d359-36a5-4a42-aa6d-f48cc384e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:04.295945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:04.357810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1154/2321] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:04.362328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:04.372457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b0b0-2411-42d7-8a24-09223011cc75 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:04.380388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:04.381234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:04.381868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:04.382345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:04.383301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:04.385599 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:04.413142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1168/2322] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:35:04 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:35:04.417221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d359-36a5-4a42-aa6d-f48cc384e39e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:04.428212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d359-36a5-4a42-aa6d-f48cc384e39e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:04.490527 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:04.491224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:04.491510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:04.491789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:04.492472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:04.494439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:04.518680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1155/2323] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:35:04 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:35:04.522747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:04.533574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacb169-3b43-4efc-8178-ca059dc5bcad admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:04.538432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:04.539057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:04.539343 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:04.539621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:04.540331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:04.542031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:04.554104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1169/2324] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:35:04.560477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:04.573447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41af8-4ddf-4fca-8c2f-5b2f7e00c32d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:04.578674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:04.579386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:04.579670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:04.579988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] PATH_INFO: `/v3/projects/5db8c827d5be48269967098bb09ae1da/users/d45704cc27e048b1aedc6c8d34f2fc69/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:04.603286 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db8c827d5be48269967098bb09ae1da, user_id=d45704cc27e048b1aedc6c8d34f2fc69, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:04.606116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:04.620436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1156/2325] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:35:04 2022] PUT /identity/v3/projects/5db8c827d5be48269967098bb09ae1da/users/d45704cc27e048b1aedc6c8d34f2fc69/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:35:04.624247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:04.634888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482db9b-56ae-4005-bb39-21585f609a79 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:04.741503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29c1e-390a-48f9-84cc-1b309120fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:04.742157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29c1e-390a-48f9-84cc-1b309120fe7c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:04.742437 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29c1e-390a-48f9-84cc-1b309120fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:04.742711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29c1e-390a-48f9-84cc-1b309120fe7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:04.743420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29c1e-390a-48f9-84cc-1b309120fe7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:04.745926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29c1e-390a-48f9-84cc-1b309120fe7c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:04.757901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1170/2326] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:35:04.762357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:04.776308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c6c3-8da8-4cc3-8c50-6eea968bb448 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:04.781469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df515-4bb1-42fb-9c7f-185a16f54cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:04.782163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df515-4bb1-42fb-9c7f-185a16f54cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:04.782447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df515-4bb1-42fb-9c7f-185a16f54cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:04.782731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df515-4bb1-42fb-9c7f-185a16f54cdd admin admin] PATH_INFO: `/v3/projects/5db8c827d5be48269967098bb09ae1da/users/d45704cc27e048b1aedc6c8d34f2fc69/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:04.784904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df515-4bb1-42fb-9c7f-185a16f54cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db8c827d5be48269967098bb09ae1da, user_id=d45704cc27e048b1aedc6c8d34f2fc69, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:04.787647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df515-4bb1-42fb-9c7f-185a16f54cdd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:04.821379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1157/2327] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:35:04 2022] PUT /identity/v3/projects/5db8c827d5be48269967098bb09ae1da/users/d45704cc27e048b1aedc6c8d34f2fc69/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:35:11.971509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:11.972541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:11.972969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:12.005266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] MFA Rules not processed for user `b8310ac5940945e1bb32d91834459ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:12.009110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:12.093423 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1171/2328] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:12.742865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:12.743383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:12.743500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:12.797754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] MFA Rules not processed for user `d45704cc27e048b1aedc6c8d34f2fc69`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:12.799333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:12.900213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:12.948725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1158/2329] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:12.958777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:12.960408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:12.963474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:12.965746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:13.037203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:13.088023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5a150-8bbb-41f5-bbb6-1d43b38ee2ae None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:13.092633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560213c5-eb4c-4ba1-9916-ba634c32276d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:13.093167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b546d-8ef1-4a99-ade2-5c41847b7567 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:13.094021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b546d-8ef1-4a99-ade2-5c41847b7567 service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:13.094454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b546d-8ef1-4a99-ade2-5c41847b7567 service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:13.094906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b546d-8ef1-4a99-ade2-5c41847b7567 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:13.098254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:13.098917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:13.099208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:13.100312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] PATH_INFO: `/v3/users/a546532f24d24f6b82f4c50eb3b10577` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:13.101705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a546532f24d24f6b82f4c50eb3b10577)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:13.103745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:13.167354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b546d-8ef1-4a99-ade2-5c41847b7567 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:13.170020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b546d-8ef1-4a99-ade2-5c41847b7567 service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:13.183712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1159/2330] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:35:13.184126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a546532f24d24f6b82f4c50eb3b10577'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:13.193841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a546532f24d24f6b82f4c50eb3b10577'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:13.210462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a546532f24d24f6b82f4c50eb3b10577'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:13.232315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a546532f24d24f6b82f4c50eb3b10577'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:13.233117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-479eb212-d79b-49ab-b171-cfa2034e16b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a546532f24d24f6b82f4c50eb3b10577'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:13.241098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1172/2331] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:35:12 2022] DELETE /identity/v3/users/a546532f24d24f6b82f4c50eb3b10577 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:13.246040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:13.246545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:13.250735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:13.300950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:13.302824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:13.414013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:13.414340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:13.414597 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:13.426079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1160/2332] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:13.434282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:13.436072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:13.465339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:13.466655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:13.547016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce667-afbd-4b51-8814-a33af5c59419 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:13.557749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:13.559175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:13.559175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:13.559468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:13.586090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:13.595341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:13.596988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:13.612559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1173/2333] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:35:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:35:13.617555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1161/2334] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:35:13.697519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:13.699111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:13.787469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:13.809447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133987b-bdb9-402f-b14c-f26834efab17 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:13.823536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396debe8-c723-475a-af0e-c11f15477cb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:13.824195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396debe8-c723-475a-af0e-c11f15477cb5 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:13.824476 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396debe8-c723-475a-af0e-c11f15477cb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:13.824749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396debe8-c723-475a-af0e-c11f15477cb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:13.858242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396debe8-c723-475a-af0e-c11f15477cb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:13.862024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396debe8-c723-475a-af0e-c11f15477cb5 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:13.888579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1174/2335] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:35:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:35:14.327476 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:14.334223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:14.384424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8e01-ecc0-45ec-bc30-3ed5fdb16a28 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:14.488761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:14.489498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:14.489783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:14.490069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] PATH_INFO: `/v3/projects/03acdfb90d9641af9450affe8796690e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:14.495910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03acdfb90d9641af9450affe8796690e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:14.503722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:14.586673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03acdfb90d9641af9450affe8796690e', 'request_id': 'req-7edc2926-b616-4d17-a6a2-45a330574b97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:14.593774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03acdfb90d9641af9450affe8796690e', 'request_id': 'req-7edc2926-b616-4d17-a6a2-45a330574b97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:14.610146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03acdfb90d9641af9450affe8796690e', 'request_id': 'req-7edc2926-b616-4d17-a6a2-45a330574b97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:14.627224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] The token cache is being invalidate because project 03acdfb90d9641af9450affe8796690e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:35:14.627423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:14.628107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7edc2926-b616-4d17-a6a2-45a330574b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:14.630988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1162/2336] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:35:14 2022] DELETE /identity/v3/projects/03acdfb90d9641af9450affe8796690e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:14.635615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21032963-69fd-4c18-b168-e4793cc0e6d3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:14.636134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21032963-69fd-4c18-b168-e4793cc0e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:14.636272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21032963-69fd-4c18-b168-e4793cc0e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:14.674399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-21032963-69fd-4c18-b168-e4793cc0e6d3 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:14.676098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21032963-69fd-4c18-b168-e4793cc0e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:14.964542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1175/2337] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:15.057085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a3e2-e302-4af8-8878-ffacae148260 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.057382 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a3e2-e302-4af8-8878-ffacae148260 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.057667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a3e2-e302-4af8-8878-ffacae148260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.122179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b265a3e2-e302-4af8-8878-ffacae148260 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:15.123787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b265a3e2-e302-4af8-8878-ffacae148260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:15.153333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1163/2338] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:15.155042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21032963-69fd-4c18-b168-e4793cc0e6d3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:15.177519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21032963-69fd-4c18-b168-e4793cc0e6d3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:15.186113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:15.187186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.187475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.187757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.188482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:35:15.188794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:15.190607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:15.226421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1176/2339] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:35:15.230893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265a3e2-e302-4af8-8878-ffacae148260 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:15.251430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265a3e2-e302-4af8-8878-ffacae148260 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:15.273237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:15.274703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.274997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.275309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.278752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:15.280788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:15.334953 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:15.336409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1164/2340] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:35:15 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:35:15.361696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1072a5-5344-41df-bad0-de4d0e04e116 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:15.511539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:15.512187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.512467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.512744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.513502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:15.519796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:15.562170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1177/2341] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:35:15 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:35:15.566052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:15.587677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb5e7-ec98-409f-b23e-57b768f009a5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:15.604935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:15.605788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.606081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.606360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.607083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:15.612497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:15.643532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1165/2342] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:35:15.647310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:15.659465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2222-6640-4aa8-8e7c-24bedf3c9be0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:15.678528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79d16c-d717-4f0b-8c37-33c0e9f83198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:15.679187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d16c-d717-4f0b-8c37-33c0e9f83198 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.679640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d16c-d717-4f0b-8c37-33c0e9f83198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.679930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d16c-d717-4f0b-8c37-33c0e9f83198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.682126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79d16c-d717-4f0b-8c37-33c0e9f83198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:15.683791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79d16c-d717-4f0b-8c37-33c0e9f83198 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:15.721848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1178/2343] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:35:15.722558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:15.738291 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4df0ea-eea9-4a72-981e-715a6926948b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:15.754925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:15.755914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.756433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.756873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] PATH_INFO: `/v3/projects/934397b8533a4d7d809678b5e70e9ba9/users/34c817af575b45d69457f4241131e4f6/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.778375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] RBAC: Authorizing `identity:create_grant(project_id=934397b8533a4d7d809678b5e70e9ba9, user_id=34c817af575b45d69457f4241131e4f6, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:15.798064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:15.819912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1166/2344] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:35:15 2022] PUT /identity/v3/projects/934397b8533a4d7d809678b5e70e9ba9/users/34c817af575b45d69457f4241131e4f6/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:35:15.837400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a107af-8d59-43c3-97c3-742a83765a61 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:15.842999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a107af-8d59-43c3-97c3-742a83765a61 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:15.843485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a107af-8d59-43c3-97c3-742a83765a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:15.948738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-57a107af-8d59-43c3-97c3-742a83765a61 None None] MFA Rules not processed for user `34c817af575b45d69457f4241131e4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:15.953076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57a107af-8d59-43c3-97c3-742a83765a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:16.106776 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:16.171225 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1179/2345] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:16.173408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:16.175713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:16.370702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf663a3-4b66-44e9-a985-2a7e916342af admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:16.385048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c78509-1e10-4658-91d0-eef42954d85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:16.385736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78509-1e10-4658-91d0-eef42954d85c service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:16.386019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78509-1e10-4658-91d0-eef42954d85c service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:16.386296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78509-1e10-4658-91d0-eef42954d85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:16.416422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c78509-1e10-4658-91d0-eef42954d85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:16.424865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c78509-1e10-4658-91d0-eef42954d85c service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:16.446906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1167/2346] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:35:16.494485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a107af-8d59-43c3-97c3-742a83765a61 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:16.675703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a107af-8d59-43c3-97c3-742a83765a61 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:16.691576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:16.692386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:16.692655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:16.692853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] PATH_INFO: `/v3/users/34c817af575b45d69457f4241131e4f6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:16.694170 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c817af575b45d69457f4241131e4f6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:16.696809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:16.820615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c817af575b45d69457f4241131e4f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:16.841133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c817af575b45d69457f4241131e4f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:16.863081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c817af575b45d69457f4241131e4f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:16.887913 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c817af575b45d69457f4241131e4f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:16.893867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c817af575b45d69457f4241131e4f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:16.902686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1180/2347] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:35:16 2022] DELETE /identity/v3/users/34c817af575b45d69457f4241131e4f6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:16.907604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:16.907900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:16.908179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:16.948856 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:16.950135 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:16.971761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:17.113555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1168/2348] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:17.125530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:17.127333 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:17.272529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e544-c939-4e6b-a863-3718ef83b5af admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:17.289427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47b428-3065-4c76-b0f6-400b67f60e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:17.290822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b428-3065-4c76-b0f6-400b67f60e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:17.291283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b428-3065-4c76-b0f6-400b67f60e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:17.291728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b428-3065-4c76-b0f6-400b67f60e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:17.305511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47b428-3065-4c76-b0f6-400b67f60e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:17.313828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47b428-3065-4c76-b0f6-400b67f60e6e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:17.353930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1181/2349] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:35:18.210321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:18.211950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:18.255149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ece21-385a-41ac-add2-22afb9ab0334 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:18.272302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:18.273245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:18.273569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:18.273910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] PATH_INFO: `/v3/projects/934397b8533a4d7d809678b5e70e9ba9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:18.275370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934397b8533a4d7d809678b5e70e9ba9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:18.277525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:18.392373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934397b8533a4d7d809678b5e70e9ba9', 'request_id': 'req-81a821a3-5895-4c39-85c6-a485eafde7e1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:18.411287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934397b8533a4d7d809678b5e70e9ba9', 'request_id': 'req-81a821a3-5895-4c39-85c6-a485eafde7e1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:18.428987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934397b8533a4d7d809678b5e70e9ba9', 'request_id': 'req-81a821a3-5895-4c39-85c6-a485eafde7e1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:18.452558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] The token cache is being invalidate because project 934397b8533a4d7d809678b5e70e9ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:35:18.453466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:18.455115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-81a821a3-5895-4c39-85c6-a485eafde7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:18.458494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1169/2350] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:35:18 2022] DELETE /identity/v3/projects/934397b8533a4d7d809678b5e70e9ba9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:18.463826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66d3c3-49b0-407d-8703-250add335fff None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:18.464355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66d3c3-49b0-407d-8703-250add335fff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:18.464473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66d3c3-49b0-407d-8703-250add335fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:18.476625 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:18.507495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6d66d3c3-49b0-407d-8703-250add335fff None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:18.509918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6d66d3c3-49b0-407d-8703-250add335fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:18.712287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1182/2351] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:18.715306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816de4-4fde-4f03-a388-39094337a693 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:18.715618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816de4-4fde-4f03-a388-39094337a693 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:18.715912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816de4-4fde-4f03-a388-39094337a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:18.765335 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e6816de4-4fde-4f03-a388-39094337a693 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:18.772115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e6816de4-4fde-4f03-a388-39094337a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:18.829368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1170/2352] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:18.884380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66d3c3-49b0-407d-8703-250add335fff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:18.928531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66d3c3-49b0-407d-8703-250add335fff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:18.936147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:18.936765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:18.937046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:18.937337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:18.938066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:35:18.938370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:18.942861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:18.980998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1183/2353] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:35:18.989947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816de4-4fde-4f03-a388-39094337a693 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:19.014375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816de4-4fde-4f03-a388-39094337a693 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:19.032593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:19.033736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:19.034907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:19.035313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:19.041217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:19.043990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:19.103368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1171/2354] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:35:18 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:35:19.108401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:19.120498 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74b47-27d4-4f0e-a047-89a8d2211141 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:19.380815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:19.381746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:19.382145 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:19.382595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:19.391842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:19.394494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:19.477539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:19.489699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1184/2355] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:35:19 2022] POST /identity/v3/users => generated 300 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:35:19.492166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f58e74-bbef-41ba-872f-e6fa32059236 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:19.506033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:19.507146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:19.507595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:19.508824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:19.510324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:19.516063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:19.567858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1172/2356] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:35:19.569671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:19.589599 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083616-de42-43cc-a7c3-4ac8b22d14e4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:19.611965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f76aa-32aa-41ff-a664-d0fcd5ba2444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:19.612640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f76aa-32aa-41ff-a664-d0fcd5ba2444 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:19.612923 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f76aa-32aa-41ff-a664-d0fcd5ba2444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:19.613215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f76aa-32aa-41ff-a664-d0fcd5ba2444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:19.613985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f76aa-32aa-41ff-a664-d0fcd5ba2444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:19.615901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f76aa-32aa-41ff-a664-d0fcd5ba2444 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:19.653083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1185/2357] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:35:19.658680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:19.669248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2368b-350b-49dc-aa41-725a409031d5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:19.699664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:19.700605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:19.701055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:19.701534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] PATH_INFO: `/v3/projects/a6c140c2e1fb467d838a2a1443d9bf94/users/d95aecd09c51433f88b429f392e88e85/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:19.754520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c140c2e1fb467d838a2a1443d9bf94, user_id=d95aecd09c51433f88b429f392e88e85, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:19.776994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:19.826319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1173/2358] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:35:19 2022] PUT /identity/v3/projects/a6c140c2e1fb467d838a2a1443d9bf94/users/d95aecd09c51433f88b429f392e88e85/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:35:19.831894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04f6a-7f93-47f8-9228-bc461efe9c94 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:19.832369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04f6a-7f93-47f8-9228-bc461efe9c94 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:19.832487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04f6a-7f93-47f8-9228-bc461efe9c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:19.914245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a7a04f6a-7f93-47f8-9228-bc461efe9c94 None None] MFA Rules not processed for user `d95aecd09c51433f88b429f392e88e85`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:19.917575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a7a04f6a-7f93-47f8-9228-bc461efe9c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:20.092596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:20.116449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1186/2359] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:20.127831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:20.130045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:20.313826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:20.382651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c6c4-79df-4320-b648-60907355661c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:20.394838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:20.395736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:20.396255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:20.396810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:20.421434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:20.427156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:20.468466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1174/2360] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:35:24.037078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c4d8-75b9-499a-8a1e-67f80f8aaeef None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:24.037782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c4d8-75b9-499a-8a1e-67f80f8aaeef None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:24.037889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c4d8-75b9-499a-8a1e-67f80f8aaeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:24.059282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d809c4d8-75b9-499a-8a1e-67f80f8aaeef None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:24.060841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d809c4d8-75b9-499a-8a1e-67f80f8aaeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:24.132363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1187/2361] 10.222.0.47 () {58 vars in 967 bytes} [Fri Jul 29 08:35:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:24.147811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:24.149672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:24.247741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d8524-3e6a-48e0-9603-96abdc7b378a service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:24.253732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:24.253732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:24.254028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:24.254308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:24.263428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:24.265018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:24.277037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1175/2362] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 29 08:35:27.083148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:27.083787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:27.083787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:27.103054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] MFA Rules not processed for user `bc5dde72e9424e688a69b819fab7424e`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:27.104269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:27.162004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1188/2363] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:30.507304 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:30.509034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:30.584323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072a77-19d8-46fb-acb5-ad6f0dd655f0 service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:30.589502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:30.590171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:30.590453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:30.590854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:30.592889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:30.606100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:30.611293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:30.623916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1176/2364] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:35:30.642968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:30.645506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:30.718590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf87fb4-deb7-42ef-bc71-ca65c38af9af None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:30.723677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:30.725147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:30.725147 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:30.725366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] PATH_INFO: `/v3/users/3a893bdd4583472e96dbeec186542061` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:30.726611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a893bdd4583472e96dbeec186542061)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:30.728723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:30.794917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a893bdd4583472e96dbeec186542061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:30.799232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:30.807113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a893bdd4583472e96dbeec186542061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:30.819014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a893bdd4583472e96dbeec186542061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:30.833951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a893bdd4583472e96dbeec186542061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:30.834671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0704dd43-b6ab-47cf-85f5-aa58e77b95b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a893bdd4583472e96dbeec186542061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:30.843760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1189/2365] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:35:30 2022] DELETE /identity/v3/users/3a893bdd4583472e96dbeec186542061 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:31.048851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.059716 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245ee8e-ff36-4fac-b6c6-75a26e4a3520 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.133493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:31.140592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.141259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.141577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.141902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] PATH_INFO: `/v3/projects/4b0b93f5e70f4a2594ab6ac6f3e4527c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.143041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0b93f5e70f4a2594ab6ac6f3e4527c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.145037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.191970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'request_id': 'req-7db62e57-a2a5-4699-b7d7-a30cec2d2406'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.198137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'request_id': 'req-7db62e57-a2a5-4699-b7d7-a30cec2d2406'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.207385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'request_id': 'req-7db62e57-a2a5-4699-b7d7-a30cec2d2406'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.218759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] The token cache is being invalidate because project 4b0b93f5e70f4a2594ab6ac6f3e4527c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:35:31.219044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.219708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7db62e57-a2a5-4699-b7d7-a30cec2d2406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.221269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1177/2366] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:35:31 2022] DELETE /identity/v3/projects/4b0b93f5e70f4a2594ab6ac6f3e4527c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:31.226267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5e3e-b64c-4f09-87a9-09bf826ce8cb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.226556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5e3e-b64c-4f09-87a9-09bf826ce8cb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.226937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5e3e-b64c-4f09-87a9-09bf826ce8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.246667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-16ca5e3e-b64c-4f09-87a9-09bf826ce8cb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:31.247878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-16ca5e3e-b64c-4f09-87a9-09bf826ce8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:31.319469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1190/2367] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:31.327616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.327910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.328221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.351410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:31.353221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:31.362456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1178/2368] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:31.367227 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca5e3e-b64c-4f09-87a9-09bf826ce8cb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.377223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.378791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:31.380950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca5e3e-b64c-4f09-87a9-09bf826ce8cb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.386425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.387063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.387347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.387623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.388330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:35:31.388639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.390301 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.391164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bccaf4-cc99-4806-b5e3-1c0e6e74b942 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.396225 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.396876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.397161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.397472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] PATH_INFO: `/v3/users/d95aecd09c51433f88b429f392e88e85` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.398863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95aecd09c51433f88b429f392e88e85)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.400826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.403418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1191/2369] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:35:31.407693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.419096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395b6ef-1aba-41ce-b933-4a590171c929 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.425867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.428800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.429124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.432223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.433047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.435189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.462674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95aecd09c51433f88b429f392e88e85'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.473691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1192/2370] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:35:31 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:35:31.473880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95aecd09c51433f88b429f392e88e85'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.474829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.485807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95aecd09c51433f88b429f392e88e85'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.496787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95aecd09c51433f88b429f392e88e85'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.497594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74f13698-8fab-4639-bc0d-23e6d7268cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95aecd09c51433f88b429f392e88e85'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:31.507468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1179/2371] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:35:31 2022] DELETE /identity/v3/users/d95aecd09c51433f88b429f392e88e85 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:31.512906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.513269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.513589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.538233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:31.539681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:31.547958 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf32374-8dd1-423c-a1fb-d5a694465a09 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.603669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:31.607396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:31.634671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.635669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.636447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.638086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.639318 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.639891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1180/2372] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:35:31.642713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.649522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.651174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:31.680754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1193/2373] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:35:31 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:35:31.684729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.686539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:31.701603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52271c2d-17a3-40b8-97e2-e30a840411c0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.707853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.709048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.709450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.710038 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.710916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.713128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.730499 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1194/2374] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:35:31.731473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.743402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c26fd-3ebd-4536-a2a1-e36d5c4c0075 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.748530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.749304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.749753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.750126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.751281 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.753009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.762034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b5fc3-2b37-4cfd-a66d-8c3777a16888 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.765353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1195/2375] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:35:31.767581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a90821-7a34-4c12-b53b-ee24aef7bafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.768448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90821-7a34-4c12-b53b-ee24aef7bafb service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.768736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90821-7a34-4c12-b53b-ee24aef7bafb service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.769012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90821-7a34-4c12-b53b-ee24aef7bafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.769989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:31.779080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a90821-7a34-4c12-b53b-ee24aef7bafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.780521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a90821-7a34-4c12-b53b-ee24aef7bafb service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.783450 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626087b-cb58-4210-ab84-ebebb4edfd16 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:31.790826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca8f62-1ff9-440e-ae58-e32045d9874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:31.791100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1181/2376] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:35:31.794148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8f62-1ff9-440e-ae58-e32045d9874c admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.794442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8f62-1ff9-440e-ae58-e32045d9874c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.794779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8f62-1ff9-440e-ae58-e32045d9874c admin admin] PATH_INFO: `/v3/projects/2cd55aaa9b8944338a7a6ca8740fa8dd/users/a4da8496f93a491c81c86a764e4ad919/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.812257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca8f62-1ff9-440e-ae58-e32045d9874c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd55aaa9b8944338a7a6ca8740fa8dd, user_id=a4da8496f93a491c81c86a764e4ad919, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:31.815156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca8f62-1ff9-440e-ae58-e32045d9874c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:31.838155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1196/2377] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:35:31 2022] PUT /identity/v3/projects/2cd55aaa9b8944338a7a6ca8740fa8dd/users/a4da8496f93a491c81c86a764e4ad919/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:31.848282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.848572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.848848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.881064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] MFA Rules not processed for user `a4da8496f93a491c81c86a764e4ad919`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:31.882408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:31.894510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:31.895098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:31.895760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:31.929667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:31.932634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:32.013242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1182/2378] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:32.024806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:32.025133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1197/2379] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:35:32.027174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:32.040358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:32.042748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:32.115353 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf579be-3f0d-488b-bdfc-5249fc5df463 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:32.120545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:32.121370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:32.121769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:32.122166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:32.132186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66cb0c-9b35-437f-98b3-10c8815dc125 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:32.138289 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:32.138878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:32.139165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:32.139470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:32.147803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:32.150301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:32.167055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:32.170815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:32.174838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1183/2380] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:35:32.194920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1198/2381] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:35:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 29 08:35:32.262059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:32.263528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:32.349860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:32.412058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9529-48d2-43c7-a07a-95bd672a72c3 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:32.439503 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:32.440188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:32.440497 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:32.441566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] PATH_INFO: `/v3/projects/a6c140c2e1fb467d838a2a1443d9bf94` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:32.443024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c140c2e1fb467d838a2a1443d9bf94)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:32.445003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:32.598572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c140c2e1fb467d838a2a1443d9bf94', 'request_id': 'req-d3f630e9-9f41-4516-839d-e708447c885d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:32.606741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c140c2e1fb467d838a2a1443d9bf94', 'request_id': 'req-d3f630e9-9f41-4516-839d-e708447c885d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:32.636708 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c140c2e1fb467d838a2a1443d9bf94', 'request_id': 'req-d3f630e9-9f41-4516-839d-e708447c885d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:32.659852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] The token cache is being invalidate because project a6c140c2e1fb467d838a2a1443d9bf94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:35:32.660176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:32.660905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3f630e9-9f41-4516-839d-e708447c885d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:32.662598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1184/2382] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:35:32 2022] DELETE /identity/v3/projects/a6c140c2e1fb467d838a2a1443d9bf94 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:42.186969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:42.650587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:46.546921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:46.558642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb062b-b2c6-439d-91fe-469c649e6196 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:46.620334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:46.620998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:46.621275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:46.621576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] PATH_INFO: `/v3/users/a4da8496f93a491c81c86a764e4ad919` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:46.622895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4da8496f93a491c81c86a764e4ad919)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:46.624866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:46.673485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4da8496f93a491c81c86a764e4ad919'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:46.680398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4da8496f93a491c81c86a764e4ad919'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:46.689354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4da8496f93a491c81c86a764e4ad919'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:46.701991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4da8496f93a491c81c86a764e4ad919'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:46.702665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4da8496f93a491c81c86a764e4ad919'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:46.709206 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1199/2383] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:35:46 2022] DELETE /identity/v3/users/a4da8496f93a491c81c86a764e4ad919 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:46.713712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:46.714323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:46.714562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:46.734303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:35:46.735683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:46.797114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1185/2384] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:35:46.807082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:46.808615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:46.866978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25636b3-e927-4f5c-948f-e5e4c8d5e654 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:46.871336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:46.871977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:46.872254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:46.872526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:46.881638 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:46.883097 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:46.892925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1200/2385] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:35:47.177880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:35:47.179422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:35:47.200680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c361-2bf8-4899-996b-c1bef3e28d7c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:35:47.207674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:35:47.208342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:35:47.208652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:35:47.208929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] PATH_INFO: `/v3/projects/2cd55aaa9b8944338a7a6ca8740fa8dd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:35:47.210649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd55aaa9b8944338a7a6ca8740fa8dd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:35:47.214942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:35:47.273555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd55aaa9b8944338a7a6ca8740fa8dd', 'request_id': 'req-058a8c70-9111-42d8-ae45-463674dc5d59'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:47.279821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd55aaa9b8944338a7a6ca8740fa8dd', 'request_id': 'req-058a8c70-9111-42d8-ae45-463674dc5d59'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:47.289505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd55aaa9b8944338a7a6ca8740fa8dd', 'request_id': 'req-058a8c70-9111-42d8-ae45-463674dc5d59'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:47.303358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] The token cache is being invalidate because project 2cd55aaa9b8944338a7a6ca8740fa8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:35:47.303651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:47.304311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:35:47.305994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1186/2386] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:35:47 2022] DELETE /identity/v3/projects/2cd55aaa9b8944338a7a6ca8740fa8dd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:35:56.888982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:57.300374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:09.135934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:36:09.145238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec2a0-cb32-494f-83d5-97570afd6738 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:36:09.197051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f779-4509-497f-a99e-9ef7102fddf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:36:09.197693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f779-4509-497f-a99e-9ef7102fddf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:36:09.197943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f779-4509-497f-a99e-9ef7102fddf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:36:09.198221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f779-4509-497f-a99e-9ef7102fddf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:36:09.200119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8a58f779-4509-497f-a99e-9ef7102fddf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:36:09.280112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f779-4509-497f-a99e-9ef7102fddf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:36:09.281723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f779-4509-497f-a99e-9ef7102fddf0 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:36:09.292045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1201/2387] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:36:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:36:11.529038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:36:11.531085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:36:11.545183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a8c70-9111-42d8-ae45-463674dc5d59 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:36:11.548772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:36:11.549515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:36:11.549800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:36:11.550080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:36:11.551861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:36:11.631688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:36:11.633357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:36:11.646397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1187/2388] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:36:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:36:19.287321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=50 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:21.642740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=30 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:48.904303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:36:48.904855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:36:48.904855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:36:48.924074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] MFA Rules not processed for user `23df9992ac7b4e89ba4dddef5b7e14a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:36:48.925322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:36:48.991156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1202/2389] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:36:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:36:58.980767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=25 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:34.314752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:37:34.316464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:34.392384 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc0263-dfbb-4585-82aa-c878c04d37a9 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:37:34.398905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:37:34.399528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:37:34.399810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:37:34.400086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:37:34.402077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:34.463811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:37:34.465472 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:37:34.475064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1188/2390] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:37:34.527185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:37:34.529344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:34.592898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbfd1-8070-43ae-8b92-b2f88d75d741 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:37:34.596433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:37:34.597058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:37:34.597369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:37:34.597646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:37:34.599351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:34.618734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:37:34.620191 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:37:34.631098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1203/2391] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:37:42.136704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:37:42.155538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470bf0-80b7-4b56-9721-e1ae3e8c8ec5 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:37:42.161031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:37:42.161707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:37:42.161992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:37:42.162263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:37:42.164303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:42.175409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:37:42.177003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:37:42.186172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1189/2392] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:37:42.577576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:37:42.587122 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76133b-60c8-412c-84d7-989b669e7edc service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:37:42.591547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3004-652a-4f3e-a2a3-4842e0d11ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:37:42.592247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3004-652a-4f3e-a2a3-4842e0d11ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:37:42.592606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3004-652a-4f3e-a2a3-4842e0d11ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:37:42.592945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3004-652a-4f3e-a2a3-4842e0d11ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:37:42.594979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-536c3004-652a-4f3e-a2a3-4842e0d11ea6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:42.609359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3004-652a-4f3e-a2a3-4842e0d11ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:37:42.610806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3004-652a-4f3e-a2a3-4842e0d11ea6 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:37:42.622521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1204/2393] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:37:52.182908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=62 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:52.617415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=32 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:55.638955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:37:55.658893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d96ce1-7202-43c6-9277-a3090b8b05cb service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:37:55.666378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:37:55.667002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:37:55.667282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:37:55.667554 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:37:55.669873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:55.731946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:37:55.733652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:37:55.743839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1190/2394] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:37:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:37:59.648190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:37:59.648735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:37:59.648735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:37:59.675918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] MFA Rules not processed for user `b8310ac5940945e1bb32d91834459ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:37:59.677140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:37:59.685373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1205/2395] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:37:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:38:04.701271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:38:04.715638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d687bc-a6ca-4597-b864-19d1cb6c0ecf service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:38:04.724787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e24c6-7072-4223-8dfb-94d30777f26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:38:04.724787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e24c6-7072-4223-8dfb-94d30777f26a service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:38:04.724787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e24c6-7072-4223-8dfb-94d30777f26a service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:38:04.724787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e24c6-7072-4223-8dfb-94d30777f26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:38:04.726808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b94e24c6-7072-4223-8dfb-94d30777f26a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:04.740370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e24c6-7072-4223-8dfb-94d30777f26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:38:04.742082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e24c6-7072-4223-8dfb-94d30777f26a service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:38:04.752831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1191/2396] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:38:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:38:09.669761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:14.748458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=34 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:28.039398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:38:28.041042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:28.059293 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b630d-72b6-460e-ae4e-bdfb951eea74 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:38:28.068841 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:38:28.070640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:38:28.071177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:38:28.073642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:38:28.075725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:28.090549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:38:28.092753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:38:28.105569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1206/2397] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:38:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:38:38.101573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:39.725977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:38:39.726524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:38:39.726524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:38:39.746555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] MFA Rules not processed for user `23df9992ac7b4e89ba4dddef5b7e14a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:38:39.747801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:39.755461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1192/2398] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:38:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:38:40.062541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:38:40.065004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:40.082448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed6fe-a88d-4943-aeea-ceee0acd4d3a service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:38:40.087092 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:38:40.087711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:38:40.087996 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:38:40.088254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:38:40.090315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:40.100296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:38:40.101795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:38:40.111032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1207/2399] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:38:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:38:40.442867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:38:40.444413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:40.519012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f99ff-5991-4a81-9b97-31d8d981a67a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:38:40.524124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff7741-4824-4897-a1bb-78fc430c0078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:38:40.524756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7741-4824-4897-a1bb-78fc430c0078 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:38:40.525042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7741-4824-4897-a1bb-78fc430c0078 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:38:40.525352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7741-4824-4897-a1bb-78fc430c0078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:38:40.527209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e8ff7741-4824-4897-a1bb-78fc430c0078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:40.540318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff7741-4824-4897-a1bb-78fc430c0078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:38:40.541944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff7741-4824-4897-a1bb-78fc430c0078 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:38:40.554623 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1193/2400] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:38:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:38:50.106618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:50.547721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=35 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:50.562495 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:38:50.576419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a7f3-96d3-4f74-af16-abe9047462ea service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:38:50.582533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94a401-34ad-4081-a49d-eee76a71a6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:38:50.583233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94a401-34ad-4081-a49d-eee76a71a6e4 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:38:50.583505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94a401-34ad-4081-a49d-eee76a71a6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:38:50.583782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94a401-34ad-4081-a49d-eee76a71a6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:38:50.585640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ad94a401-34ad-4081-a49d-eee76a71a6e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:38:50.598924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94a401-34ad-4081-a49d-eee76a71a6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:38:50.600583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94a401-34ad-4081-a49d-eee76a71a6e4 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:38:50.611484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1208/2401] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:38:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:00.606822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:04.630539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b88b3-a633-4104-ab8a-d1ae72e6a211 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:04.631444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b88b3-a633-4104-ab8a-d1ae72e6a211 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:04.631876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b88b3-a633-4104-ab8a-d1ae72e6a211 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:04.633597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1194/2402] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:39:04.639716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b85a-28e2-4c8c-b090-064975d553c4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:04.640251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b85a-28e2-4c8c-b090-064975d553c4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:04.640342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b85a-28e2-4c8c-b090-064975d553c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:04.661918 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3c68b85a-28e2-4c8c-b090-064975d553c4 None None] MFA Rules not processed for user `2929dcc2eee6498393466499b61d6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:04.663156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3c68b85a-28e2-4c8c-b090-064975d553c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:04.671791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1209/2403] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:39:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:04.684961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b88b3-a633-4104-ab8a-d1ae72e6a211 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:04.696054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b88b3-a633-4104-ab8a-d1ae72e6a211 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:04.700312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2c970-3627-4459-be4c-f750dec02d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:04.700929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c970-3627-4459-be4c-f750dec02d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:04.701210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c970-3627-4459-be4c-f750dec02d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:04.701520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c970-3627-4459-be4c-f750dec02d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:04.709719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c970-3627-4459-be4c-f750dec02d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:04.711161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c970-3627-4459-be4c-f750dec02d6c service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:04.719507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1195/2404] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:04.808799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30e25-ecae-44ad-94f8-59eac801ae1f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:04.809111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30e25-ecae-44ad-94f8-59eac801ae1f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:04.809420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30e25-ecae-44ad-94f8-59eac801ae1f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:04.810814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1210/2405] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:39:04.816185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bf33-3616-4522-8a9c-ce77856df61d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:04.816479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bf33-3616-4522-8a9c-ce77856df61d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:04.816764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bf33-3616-4522-8a9c-ce77856df61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:04.836962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8cd5bf33-3616-4522-8a9c-ce77856df61d None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:04.838279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8cd5bf33-3616-4522-8a9c-ce77856df61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:04.848119 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1196/2406] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:39:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:04.858920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e30e25-ecae-44ad-94f8-59eac801ae1f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:04.871179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e30e25-ecae-44ad-94f8-59eac801ae1f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:04.875036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:04.875637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:04.875911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:04.876181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:04.886676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:04.888116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:04.898991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1211/2407] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:10.040366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd2516-92d8-461d-be83-fd2e2c4b89cd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:10.040838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd2516-92d8-461d-be83-fd2e2c4b89cd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:10.040950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd2516-92d8-461d-be83-fd2e2c4b89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:10.060650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-73fd2516-92d8-461d-be83-fd2e2c4b89cd None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:10.061851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-73fd2516-92d8-461d-be83-fd2e2c4b89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:10.119218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1197/2408] 10.222.0.47 () {58 vars in 967 bytes} [Fri Jul 29 08:39:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:10.165015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:10.166513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:10.262366 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f75d-eb2f-4952-af58-a2a1fb22f8e1 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:10.267962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:10.268595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:10.268878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:10.269150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:10.277697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:10.279307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:10.287394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1212/2409] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:39:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:39:14.152957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd2516-92d8-461d-be83-fd2e2c4b89cd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:14.166362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd2516-92d8-461d-be83-fd2e2c4b89cd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:14.171984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:14.172704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:14.173003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:14.173268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:14.175128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:14.187285 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:14.188940 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:14.199817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1198/2410] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:17.593130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:17.594629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:17.667969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33933d03-904b-45a8-8767-c4048b456a25 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:17.674951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:17.675616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:17.675897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:17.676168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] PATH_INFO: `/v3/users/bc5dde72e9424e688a69b819fab7424e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:17.677407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5dde72e9424e688a69b819fab7424e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:17.679384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:17.741824 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5dde72e9424e688a69b819fab7424e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:17.752277 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5dde72e9424e688a69b819fab7424e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:17.765517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5dde72e9424e688a69b819fab7424e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:17.774089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:17.780587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5dde72e9424e688a69b819fab7424e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:17.781706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5dde72e9424e688a69b819fab7424e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:17.790029 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1213/2411] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:39:17 2022] DELETE /identity/v3/users/bc5dde72e9424e688a69b819fab7424e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:39:18.424836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:18.436438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6492a-5940-4209-bedb-85129032aeb4 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:18.514788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:18.515351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:18.515638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:18.515910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] PATH_INFO: `/v3/projects/837c36665fa2423580371cadf33db911` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:18.517305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=837c36665fa2423580371cadf33db911)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:18.519163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:18.574882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837c36665fa2423580371cadf33db911', 'request_id': 'req-af26e61f-0c1f-4716-81ac-1a7a9342c15a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.580653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837c36665fa2423580371cadf33db911', 'request_id': 'req-af26e61f-0c1f-4716-81ac-1a7a9342c15a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.589259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837c36665fa2423580371cadf33db911', 'request_id': 'req-af26e61f-0c1f-4716-81ac-1a7a9342c15a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.603282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] The token cache is being invalidate because project 837c36665fa2423580371cadf33db911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:39:18.603667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.604457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.606253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1199/2412] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:39:18 2022] DELETE /identity/v3/projects/837c36665fa2423580371cadf33db911 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:39:18.610397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:18.612007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:18.625743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3221cf-7f43-4f2c-b558-954c745238b1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:18.687328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:18.687981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:18.688260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:18.688531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] PATH_INFO: `/v3/users/d45704cc27e048b1aedc6c8d34f2fc69` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:18.689753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45704cc27e048b1aedc6c8d34f2fc69)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:18.691699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:18.740796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45704cc27e048b1aedc6c8d34f2fc69'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.748188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45704cc27e048b1aedc6c8d34f2fc69'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.757608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45704cc27e048b1aedc6c8d34f2fc69'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.770847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45704cc27e048b1aedc6c8d34f2fc69'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.771582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d7d021-7ff6-48fa-b268-9e3314efe4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45704cc27e048b1aedc6c8d34f2fc69'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:18.777721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1214/2413] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:39:18 2022] DELETE /identity/v3/users/d45704cc27e048b1aedc6c8d34f2fc69 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:39:19.311573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:19.313380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:19.322780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:19.347568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26e61f-0c1f-4716-81ac-1a7a9342c15a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:19.417570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:19.418237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:19.418509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:19.418784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] PATH_INFO: `/v3/projects/5db8c827d5be48269967098bb09ae1da` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:19.419955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db8c827d5be48269967098bb09ae1da)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:19.421997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:19.472314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db8c827d5be48269967098bb09ae1da', 'request_id': 'req-b510e860-d621-46f8-8ed4-f4d0b56f9e61'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:19.478027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db8c827d5be48269967098bb09ae1da', 'request_id': 'req-b510e860-d621-46f8-8ed4-f4d0b56f9e61'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:19.486288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db8c827d5be48269967098bb09ae1da', 'request_id': 'req-b510e860-d621-46f8-8ed4-f4d0b56f9e61'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:19.497909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] The token cache is being invalidate because project 5db8c827d5be48269967098bb09ae1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:39:19.498198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:19.498880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:19.500506 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1200/2414] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:39:19 2022] DELETE /identity/v3/projects/5db8c827d5be48269967098bb09ae1da => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:39:28.774109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=57,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:29.494737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:31.034543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:31.035068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:31.035188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:31.058988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] MFA Rules not processed for user `5b6e13a14dd64724aaff936a6c1e3d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:31.060202 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:31.117305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1215/2415] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:39:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:31.451866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:31.453883 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:31.514260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e860-d621-46f8-8ed4-f4d0b56f9e61 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:31.518546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:31.519173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:31.519490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:31.519768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:31.521742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:31.531765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:31.533388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:31.541589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1201/2416] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:34.170607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:34.172184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:34.187107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd49a-cc86-472f-899e-c5a948da6ff9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:34.191347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:34.198984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:34.199300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:34.199585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:34.201648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:34.270158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:34.271681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:34.281501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1216/2417] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:37.899873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:37.901449 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:37.984343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39620e07-3b1a-42bb-8776-775120dacfd9 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:37.989550 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:37.990302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:37.990576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:37.990835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:37.992784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:38.005513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.007749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.008528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.010031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:38.017742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1202/2418] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:38.023106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4b22-4876-4db9-865f-f43b2e01371f service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.028730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.029624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.029904 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.030302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] PATH_INFO: `/v3/users/b8310ac5940945e1bb32d91834459ddc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.031349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8310ac5940945e1bb32d91834459ddc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.033539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.096024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8310ac5940945e1bb32d91834459ddc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.103955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8310ac5940945e1bb32d91834459ddc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.115751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8310ac5940945e1bb32d91834459ddc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.129213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8310ac5940945e1bb32d91834459ddc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.129966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99204fb3-6fa5-4a65-9424-182d5c5e2cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8310ac5940945e1bb32d91834459ddc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.136447 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1217/2419] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:39:38 2022] DELETE /identity/v3/users/b8310ac5940945e1bb32d91834459ddc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:39:38.313008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.323838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc0f2-8a5b-4b1b-bea2-5ff97ceef897 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.385509 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.386084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.386365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.386644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] PATH_INFO: `/v3/projects/b4e7b611334347d3aa5ba3ce972a9dcc` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.387905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e7b611334347d3aa5ba3ce972a9dcc)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.389863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.430948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:38.440936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'request_id': 'req-f5b7f634-8119-422f-b92e-4768c67b8792'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.446441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'request_id': 'req-f5b7f634-8119-422f-b92e-4768c67b8792'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.454799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'request_id': 'req-f5b7f634-8119-422f-b92e-4768c67b8792'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.466015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] The token cache is being invalidate because project b4e7b611334347d3aa5ba3ce972a9dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:39:38.466310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.466942 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5b7f634-8119-422f-b92e-4768c67b8792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:39:38.468466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1203/2420] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:39:38 2022] DELETE /identity/v3/projects/b4e7b611334347d3aa5ba3ce972a9dcc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:39:38.473849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b71ca4-b78b-444f-9bfb-f291123c1991 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.474181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b71ca4-b78b-444f-9bfb-f291123c1991 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.474398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b71ca4-b78b-444f-9bfb-f291123c1991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.494821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f0b71ca4-b78b-444f-9bfb-f291123c1991 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:38.496024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f0b71ca4-b78b-444f-9bfb-f291123c1991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:38.501909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:38.561212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1218/2421] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:38.570159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ecc8a-cbf8-4a14-9654-f91b5304510a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.570447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ecc8a-cbf8-4a14-9654-f91b5304510a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.570797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ecc8a-cbf8-4a14-9654-f91b5304510a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.592630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-001ecc8a-cbf8-4a14-9654-f91b5304510a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:38.594013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-001ecc8a-cbf8-4a14-9654-f91b5304510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:38.603211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1204/2422] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:38.607737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b71ca4-b78b-444f-9bfb-f291123c1991 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.618143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b71ca4-b78b-444f-9bfb-f291123c1991 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.623745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.624449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.624744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.625025 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.625795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:39:38.626060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.627699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.639375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1219/2423] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:39:38.643559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ecc8a-cbf8-4a14-9654-f91b5304510a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.653320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ecc8a-cbf8-4a14-9654-f91b5304510a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.659300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.659920 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.660204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.660477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.661168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.663129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.692614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1205/2424] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:39:38 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:39:38.696917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.708026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6c7b-b45e-45a4-822a-668c20c49df5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.769973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.770615 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.770896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.771375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.772075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.774243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.798648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1220/2425] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:39:38 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:39:38.802967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.813998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215566-5cb7-455d-86dd-016b0feb8582 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.819104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.819739 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.820024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.820298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.821015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.822727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.834383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1206/2426] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:39:38.838531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.849274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb27ff-07d7-42b0-aa87-07ef17252c06 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.854026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa52a9-0637-4c52-aa7c-6cbfa9304403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.854656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa52a9-0637-4c52-aa7c-6cbfa9304403 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.854942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa52a9-0637-4c52-aa7c-6cbfa9304403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.855228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa52a9-0637-4c52-aa7c-6cbfa9304403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.855919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa52a9-0637-4c52-aa7c-6cbfa9304403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.857606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa52a9-0637-4c52-aa7c-6cbfa9304403 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.868451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1221/2427] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:39:38.872798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:38.884061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd0d5-a152-4c30-88ca-4e0305cf531a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:38.893435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:38.894168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.894319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.894596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] PATH_INFO: `/v3/projects/0c161e438fee4a29b0f89ab266117e6c/users/47b7581896ed45a8987b70f3c80214b2/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.911876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c161e438fee4a29b0f89ab266117e6c, user_id=47b7581896ed45a8987b70f3c80214b2, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:38.914032 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:38.930121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1207/2428] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:39:38 2022] PUT /identity/v3/projects/0c161e438fee4a29b0f89ab266117e6c/users/47b7581896ed45a8987b70f3c80214b2/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:39:38.935847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e08a4-fc33-4847-8bd5-7881bcd328dd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:38.936628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e08a4-fc33-4847-8bd5-7881bcd328dd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:38.936628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e08a4-fc33-4847-8bd5-7881bcd328dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:38.959107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b95e08a4-fc33-4847-8bd5-7881bcd328dd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:38.960353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b95e08a4-fc33-4847-8bd5-7881bcd328dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:39.028717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1222/2429] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:39.043078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:39.045531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:39.103517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fecaa9-b83c-415c-8036-84561d1e0906 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:39.107174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:39.107788 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:39.108071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:39.108346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:39.117237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:39.118694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:39.127818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1208/2430] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:39:42.999293 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f068-810e-4e18-8a53-64086a1486dd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:42.999732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f068-810e-4e18-8a53-64086a1486dd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:42.999829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f068-810e-4e18-8a53-64086a1486dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:43.035927 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1415f068-810e-4e18-8a53-64086a1486dd None None] MFA Rules not processed for user `47b7581896ed45a8987b70f3c80214b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:43.037178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1415f068-810e-4e18-8a53-64086a1486dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:43.043430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:43.107747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1223/2431] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:39:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:43.122341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:39:43.123838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:43.204820 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:43.229463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d28a9-d2d1-490f-b38a-a99c96af8266 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:39:43.236195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:39:43.236945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:43.237232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:43.237564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:43.247932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:39:43.252437 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:39:43.263720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1209/2432] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:39:44.969965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f0ac-a18f-4e6c-a412-29f2966a9092 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:39:44.970460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f0ac-a18f-4e6c-a412-29f2966a9092 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:39:44.970552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f0ac-a18f-4e6c-a412-29f2966a9092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:39:44.989946 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-df04f0ac-a18f-4e6c-a412-29f2966a9092 None None] MFA Rules not processed for user `47b7581896ed45a8987b70f3c80214b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:39:44.991327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-df04f0ac-a18f-4e6c-a412-29f2966a9092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:39:45.004212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1224/2433] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:39:53.259351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:54.984300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=27 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:10.754138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:40:10.756130 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:40:10.861731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649b077-ff6f-449b-84c5-13e6f1dbb4cc service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:40:10.868088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:40:10.868718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:40:10.869005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:40:10.869311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:40:10.871272 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:40:10.931144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:40:10.932737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:40:10.942470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1210/2434] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:40:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:40:20.938181 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=62 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:28.470890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:40:28.471442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:40:28.471442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:40:28.490795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] MFA Rules not processed for user `23df9992ac7b4e89ba4dddef5b7e14a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:40:28.491997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:40:28.499556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1225/2435] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:40:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:40:38.485479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:02.146152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:02.148808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:02.189294 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1332bc-ed92-439f-bd5f-694306f057c0 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:02.193171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:02.193825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:02.194104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:02.194383 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:02.196295 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:02.260161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:02.261656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:02.270767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1211/2436] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:06.762111 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:06.763557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:06.856867 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e01ffd-8d46-4aec-be24-317ecc3e7b02 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:06.862304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:06.862897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:06.863183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:06.863537 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:06.865389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:06.876756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:06.878389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:06.888467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1226/2437] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:08.522465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:08.531445 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217ad12-a3bb-4975-b498-54060b2984b0 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:08.535020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:08.535706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:08.535988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:08.536267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:08.538046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:08.574094 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:08.575567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:08.600501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1212/2438] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:15.005781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:15.008053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:15.023600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184c787-3493-4db7-96de-e9153566ae2d service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:15.028514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:15.029162 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:15.029478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:15.029751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] PATH_INFO: `/v3/users/fd5463700f2e4d26b84ebfb65064686d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:15.030906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5463700f2e4d26b84ebfb65064686d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:15.032862 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:15.089572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5463700f2e4d26b84ebfb65064686d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.099900 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5463700f2e4d26b84ebfb65064686d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.108062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5463700f2e4d26b84ebfb65064686d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.121410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5463700f2e4d26b84ebfb65064686d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.122080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5463700f2e4d26b84ebfb65064686d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.128200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1227/2439] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:41:15 2022] DELETE /identity/v3/users/fd5463700f2e4d26b84ebfb65064686d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:15.307696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:15.318425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c271ce-9d4c-4d9c-b0e5-9595fef4ba56 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:15.382770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:15.383413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:15.383697 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:15.383970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] PATH_INFO: `/v3/projects/ba081e6d68e3474db0be4d577294d333` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:15.385167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba081e6d68e3474db0be4d577294d333)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:15.387120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:15.430720 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:15.439461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba081e6d68e3474db0be4d577294d333', 'request_id': 'req-f4e99f42-7512-4141-a862-291e996169b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.445380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba081e6d68e3474db0be4d577294d333', 'request_id': 'req-f4e99f42-7512-4141-a862-291e996169b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.453625 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba081e6d68e3474db0be4d577294d333', 'request_id': 'req-f4e99f42-7512-4141-a862-291e996169b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.472031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] The token cache is being invalidate because project ba081e6d68e3474db0be4d577294d333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:41:15.472256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.473041 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.477627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1213/2440] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:41:15 2022] DELETE /identity/v3/projects/ba081e6d68e3474db0be4d577294d333 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:15.481957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:15.483818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:15.497885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190b6b-2ecb-49a9-8d70-e5acace8fa42 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:15.541809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:15.564196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:15.564830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:15.565136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:15.565439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] PATH_INFO: `/v3/users/a40f93d87d9646ffa70df9901b029b9b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:15.566737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40f93d87d9646ffa70df9901b029b9b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:15.568715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:15.617349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40f93d87d9646ffa70df9901b029b9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.624779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40f93d87d9646ffa70df9901b029b9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.633526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40f93d87d9646ffa70df9901b029b9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.645931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40f93d87d9646ffa70df9901b029b9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.646563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c17ef95d-41f3-41f1-9178-8d7c8d17ce46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40f93d87d9646ffa70df9901b029b9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.652567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1228/2441] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:41:15 2022] DELETE /identity/v3/users/a40f93d87d9646ffa70df9901b029b9b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:41:15.838478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:15.840252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:15.857361 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e99f42-7512-4141-a862-291e996169b2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:15.921351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:15.921970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:15.922252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:15.922529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] PATH_INFO: `/v3/projects/9d61db9b0524467182b30bb3561a5b56` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:15.923692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d61db9b0524467182b30bb3561a5b56)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:15.925747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:15.974186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d61db9b0524467182b30bb3561a5b56', 'request_id': 'req-e030d9a6-1221-4288-ba4c-1f051a96454e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.979589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d61db9b0524467182b30bb3561a5b56', 'request_id': 'req-e030d9a6-1221-4288-ba4c-1f051a96454e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.987173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d61db9b0524467182b30bb3561a5b56', 'request_id': 'req-e030d9a6-1221-4288-ba4c-1f051a96454e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.998286 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] The token cache is being invalidate because project 9d61db9b0524467182b30bb3561a5b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:41:15.998520 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:15.999139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e030d9a6-1221-4288-ba4c-1f051a96454e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:16.000655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1214/2442] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:41:15 2022] DELETE /identity/v3/projects/9d61db9b0524467182b30bb3561a5b56 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:16.005748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f846a5-e85c-4d9a-a824-867e43ee966a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.006065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f846a5-e85c-4d9a-a824-867e43ee966a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.006629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f846a5-e85c-4d9a-a824-867e43ee966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.068232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b0f846a5-e85c-4d9a-a824-867e43ee966a None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:16.069517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b0f846a5-e85c-4d9a-a824-867e43ee966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:16.140256 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1229/2443] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:16.149581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f6fa-e074-4303-95e1-fba436b33250 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.149893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f6fa-e074-4303-95e1-fba436b33250 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.150168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f6fa-e074-4303-95e1-fba436b33250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.170251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-96a2f6fa-e074-4303-95e1-fba436b33250 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:16.171479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-96a2f6fa-e074-4303-95e1-fba436b33250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:16.180128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1215/2444] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:41:16.184582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f846a5-e85c-4d9a-a824-867e43ee966a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:16.194737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f846a5-e85c-4d9a-a824-867e43ee966a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:16.199407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:16.200048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.200326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.200598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.201694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:41:16.201997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:16.203657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:16.215290 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1230/2445] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:41:16.219770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f6fa-e074-4303-95e1-fba436b33250 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:16.229688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f6fa-e074-4303-95e1-fba436b33250 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:16.234989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:16.235605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.236004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.236310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.236986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:16.238967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:16.269417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1216/2446] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:41:16 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:41:16.273717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:16.283994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de45a6-89a0-4d8a-b071-0bf21030c374 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:16.297821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:16.345985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:16.346612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.346894 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.347210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.347956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:16.349994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:16.373138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1231/2447] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:41:16 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:41:16.377452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:16.390176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364305-aea3-448f-a2a2-c015bb60025d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:16.400485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:16.401475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.401841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.402224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.403301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:16.405859 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:16.418276 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1217/2448] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:16.424714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:16.439432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267485a-df2e-47fd-97d9-1c5c20b1d2bb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:16.444658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd03d-6799-4bc4-b3d2-20e46c420f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:16.445322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd03d-6799-4bc4-b3d2-20e46c420f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.445589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd03d-6799-4bc4-b3d2-20e46c420f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.445902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd03d-6799-4bc4-b3d2-20e46c420f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.446601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fd03d-6799-4bc4-b3d2-20e46c420f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:16.448260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fd03d-6799-4bc4-b3d2-20e46c420f86 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:16.459899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1232/2449] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:16.464051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:16.474519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f73ee7-a72c-4974-bb3b-20a9430bd02f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:16.481022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:16.481735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.482048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.482312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] PATH_INFO: `/v3/projects/89452dc908b24817947b096a443e0e8f/users/8ed5256562974246b15e474439811df4/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.499237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89452dc908b24817947b096a443e0e8f, user_id=8ed5256562974246b15e474439811df4, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:16.501936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:16.504143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:16.517424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1218/2450] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:41:16 2022] PUT /identity/v3/projects/89452dc908b24817947b096a443e0e8f/users/8ed5256562974246b15e474439811df4/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:16.522695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723caec-3757-4527-a37c-08415590270d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.522989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723caec-3757-4527-a37c-08415590270d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.523273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723caec-3757-4527-a37c-08415590270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.542520 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5723caec-3757-4527-a37c-08415590270d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:16.543744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5723caec-3757-4527-a37c-08415590270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:16.605046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1233/2451] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:41:16.615298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:16.617404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:16.675261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dc474-009e-4f8a-b9fd-cde395847716 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:16.679461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:16.680077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:16.680360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:16.680633 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:16.690839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:16.692303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:16.703673 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1219/2452] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:20.597065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d564e-fe59-444d-8495-65b90acc6855 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:20.597642 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d564e-fe59-444d-8495-65b90acc6855 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:20.597749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d564e-fe59-444d-8495-65b90acc6855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:20.626919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d69d564e-fe59-444d-8495-65b90acc6855 None None] MFA Rules not processed for user `8ed5256562974246b15e474439811df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:20.628704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d69d564e-fe59-444d-8495-65b90acc6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:20.713337 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1234/2453] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:20.726746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:20.743470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e76cc1-2bec-4eae-9a9f-e9dbb659fda5 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:20.748396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:20.749058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:20.749379 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:20.749653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:20.750337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:20.752265 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:20.781324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1220/2454] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:41:20 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:41:20.785815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d564e-fe59-444d-8495-65b90acc6855 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:20.797945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d564e-fe59-444d-8495-65b90acc6855 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:20.822570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:20.856319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:20.857031 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:20.857409 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:20.857687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:20.858349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:20.860393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:20.884742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1235/2455] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:41:20 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:41:20.889329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:20.908721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cc472-cca4-40de-b7d3-6af54e377473 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:20.930155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:20.930831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:20.931112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:20.931388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:20.932103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:20.935171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:20.947159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1221/2456] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:20.952860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:20.965925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e312e5-3361-4675-bd53-7f75db01f848 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:20.970813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:20.971628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:20.972011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:20.972425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] PATH_INFO: `/v3/projects/16ca9e31760546f7a1f636598ec97b8e/users/b4d835de655f4834bb92bd94be45e340/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:20.988885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ca9e31760546f7a1f636598ec97b8e, user_id=b4d835de655f4834bb92bd94be45e340, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:20.991673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:21.009564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1236/2457] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:41:20 2022] PUT /identity/v3/projects/16ca9e31760546f7a1f636598ec97b8e/users/b4d835de655f4834bb92bd94be45e340/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:21.013848 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:21.024316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d95ef-8b45-460c-b32e-a08a4a957315 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:21.089933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49506-430a-490e-a542-844d6d47b07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:21.090573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49506-430a-490e-a542-844d6d47b07d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:21.090858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49506-430a-490e-a542-844d6d47b07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:21.091136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49506-430a-490e-a542-844d6d47b07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:21.091849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff49506-430a-490e-a542-844d6d47b07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:21.093513 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff49506-430a-490e-a542-844d6d47b07d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:21.104101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1222/2458] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:41:21.108465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:21.120402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a71b-370c-4cea-b2de-dd5cea4d18eb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:21.125349 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:21.126041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:21.126327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:21.126614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] PATH_INFO: `/v3/projects/16ca9e31760546f7a1f636598ec97b8e/users/b4d835de655f4834bb92bd94be45e340/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:21.128686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ca9e31760546f7a1f636598ec97b8e, user_id=b4d835de655f4834bb92bd94be45e340, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:21.131931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:21.143774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1237/2459] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:41:21 2022] PUT /identity/v3/projects/16ca9e31760546f7a1f636598ec97b8e/users/b4d835de655f4834bb92bd94be45e340/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:26.325438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:26.326293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:26.326391 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:26.366973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] MFA Rules not processed for user `b4d835de655f4834bb92bd94be45e340`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:26.369448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:26.439954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:26.478844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1223/2460] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:26.494296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:26.496215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:26.587805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfa1a3-cb75-4628-a3fa-22a02e4b61e5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:26.594728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a355ec-82f2-4bd7-af94-1b0885b7c25f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:26.595515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a355ec-82f2-4bd7-af94-1b0885b7c25f service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:26.595863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a355ec-82f2-4bd7-af94-1b0885b7c25f service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:26.596204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a355ec-82f2-4bd7-af94-1b0885b7c25f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:26.668007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a355ec-82f2-4bd7-af94-1b0885b7c25f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:26.669793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a355ec-82f2-4bd7-af94-1b0885b7c25f service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:26.679577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1238/2461] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:36.475058 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:36.615997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:36.617580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:36.675825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:36.676665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d874f8-9ea7-4710-8b03-b55b73d21b92 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:36.681491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:36.682216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:36.682494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:36.682767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:36.684609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:36.753174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:36.754704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:36.765157 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1224/2462] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:39.432033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:39.432554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:39.432775 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:39.465663 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:39.467037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:39.535533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1239/2463] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:41:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:41:39.588252 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:39.589843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:39.665218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b409b5d-8891-4ce7-8a8d-962e93fb653d service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:39.670829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:39.671551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:39.672071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:39.672416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:39.681907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:39.683599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:39.693430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1225/2464] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:41:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:41:40.340186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:40.342724 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:40.389115 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e86647-d752-4b49-aa03-07adf18d74c7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:40.394720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:40.396113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:40.396532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:40.396930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] PATH_INFO: `/v3/users/5b6e13a14dd64724aaff936a6c1e3d3a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:40.398413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6e13a14dd64724aaff936a6c1e3d3a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:40.400934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:40.472936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6e13a14dd64724aaff936a6c1e3d3a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.483137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6e13a14dd64724aaff936a6c1e3d3a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.500465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6e13a14dd64724aaff936a6c1e3d3a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.514686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6e13a14dd64724aaff936a6c1e3d3a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.515467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d1c788c2-b169-4f82-953c-4f386a648edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6e13a14dd64724aaff936a6c1e3d3a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.522577 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1240/2465] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:41:40 2022] DELETE /identity/v3/users/5b6e13a14dd64724aaff936a6c1e3d3a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:40.748916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:40.760201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f46cb-65d9-427f-8cd0-91d9dfa551fe service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:40.814790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:40.834185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:40.835214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:40.835750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:40.836240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] PATH_INFO: `/v3/projects/9189f8589b3a4b9fb33e3a5505160afa` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:40.837646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9189f8589b3a4b9fb33e3a5505160afa)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:40.839790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:40.900256 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9189f8589b3a4b9fb33e3a5505160afa', 'request_id': 'req-ce8fc1fb-e317-4fca-82ef-38f11f463f02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.907101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9189f8589b3a4b9fb33e3a5505160afa', 'request_id': 'req-ce8fc1fb-e317-4fca-82ef-38f11f463f02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.918097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9189f8589b3a4b9fb33e3a5505160afa', 'request_id': 'req-ce8fc1fb-e317-4fca-82ef-38f11f463f02'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.930480 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] The token cache is being invalidate because project 9189f8589b3a4b9fb33e3a5505160afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:41:40.930865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.931852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce8fc1fb-e317-4fca-82ef-38f11f463f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:40.933895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1226/2466] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:41:40 2022] DELETE /identity/v3/projects/9189f8589b3a4b9fb33e3a5505160afa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:40.938931 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd285-dada-4d03-aeb0-fcab8da22584 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:40.939223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd285-dada-4d03-aeb0-fcab8da22584 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:40.939501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd285-dada-4d03-aeb0-fcab8da22584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:40.960660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f5ecd285-dada-4d03-aeb0-fcab8da22584 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:40.961950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f5ecd285-dada-4d03-aeb0-fcab8da22584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:41.025691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1241/2467] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:41.033581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04898ddf-3b23-4775-8473-42d2277e9838 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.033881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04898ddf-3b23-4775-8473-42d2277e9838 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.034171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04898ddf-3b23-4775-8473-42d2277e9838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.057851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-04898ddf-3b23-4775-8473-42d2277e9838 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:41.059457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-04898ddf-3b23-4775-8473-42d2277e9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:41.067658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1227/2468] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:41.072061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecd285-dada-4d03-aeb0-fcab8da22584 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:41.082535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecd285-dada-4d03-aeb0-fcab8da22584 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:41.087458 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:41.088088 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.088373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.088653 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.089391 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:41:41.089705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:41.091335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:41.094027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:41.110303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04898ddf-3b23-4775-8473-42d2277e9838 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:41.113763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1242/2469] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:41:41.120471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04898ddf-3b23-4775-8473-42d2277e9838 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:41.128736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:41.129542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.129965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.130326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.131127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:41.133339 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:41.168334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1228/2470] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:41:41 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:41:41.169542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:41.182217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa741c0-0329-4274-932b-94a6d55a872f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:41.251184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:41.251528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.252426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.252706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.253488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:41.255590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:41.294805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1243/2471] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:41:41 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:41:41.299185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:41.324063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ca80-27a8-4baf-8088-624a0ab225cc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:41.330211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:41.330850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.331140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.331419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.332196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:41.333869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:41.345411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1229/2472] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:41.349370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:41.362063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1bae5-23e7-4c9a-b841-811fd4c1d7c8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:41.367134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f399c47-3773-4fa4-9e20-0e0f47c54ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:41.367887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f399c47-3773-4fa4-9e20-0e0f47c54ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.368287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f399c47-3773-4fa4-9e20-0e0f47c54ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.368652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f399c47-3773-4fa4-9e20-0e0f47c54ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.370769 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f399c47-3773-4fa4-9e20-0e0f47c54ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:41.372561 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f399c47-3773-4fa4-9e20-0e0f47c54ba3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:41.388155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1244/2473] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:41.389946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:41.402921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c5f6-d18d-4e42-91bd-901108420312 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:41.407780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:41.408459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.408766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.409027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] PATH_INFO: `/v3/projects/5ce56080e2764277bca0e38cd2b5f18a/users/514cade181dc4e7b93b5e0f44909ed8f/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.425024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce56080e2764277bca0e38cd2b5f18a, user_id=514cade181dc4e7b93b5e0f44909ed8f, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:41.427724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:41.443385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1230/2474] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:41:41 2022] PUT /identity/v3/projects/5ce56080e2764277bca0e38cd2b5f18a/users/514cade181dc4e7b93b5e0f44909ed8f/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:41.455381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb257cd-3b24-44b7-828c-40892b3c7ce9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.456095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb257cd-3b24-44b7-828c-40892b3c7ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.456600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb257cd-3b24-44b7-828c-40892b3c7ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.486157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1cb257cd-3b24-44b7-828c-40892b3c7ce9 None None] MFA Rules not processed for user `514cade181dc4e7b93b5e0f44909ed8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:41.487512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1cb257cd-3b24-44b7-828c-40892b3c7ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:41.568110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1245/2475] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:41.580812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:41.582724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:41.668120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:41.673325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574244a-d7ca-48e2-8834-9ad5cbc9aaa7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:41.681565 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d63bd-b310-42ba-9b28-0c924bd731a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:41.682280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d63bd-b310-42ba-9b28-0c924bd731a9 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:41.682578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d63bd-b310-42ba-9b28-0c924bd731a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:41.682982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d63bd-b310-42ba-9b28-0c924bd731a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:41.697431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d63bd-b310-42ba-9b28-0c924bd731a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:41.699627 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d63bd-b310-42ba-9b28-0c924bd731a9 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:41.710076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1231/2476] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:41:44.526015 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb257cd-3b24-44b7-828c-40892b3c7ce9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:44.596116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb257cd-3b24-44b7-828c-40892b3c7ce9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:44.601001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:44.601767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:44.602046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:44.602322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] PATH_INFO: `/v3/users/514cade181dc4e7b93b5e0f44909ed8f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:44.603519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514cade181dc4e7b93b5e0f44909ed8f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:44.605609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:44.610886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:44.658887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514cade181dc4e7b93b5e0f44909ed8f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:44.667047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514cade181dc4e7b93b5e0f44909ed8f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:44.676587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514cade181dc4e7b93b5e0f44909ed8f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:44.693056 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514cade181dc4e7b93b5e0f44909ed8f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:44.693875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514cade181dc4e7b93b5e0f44909ed8f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:44.704242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1246/2477] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:41:44 2022] DELETE /identity/v3/users/514cade181dc4e7b93b5e0f44909ed8f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:44.705914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:44.706400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:44.706650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:44.727201 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:44.728417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:44.787107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1232/2478] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:41:44.797005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:44.798513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:44.860128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec5fd-a55f-41ed-8d9a-ec9a644ce984 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:44.865052 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588d1c7-0368-4582-9b1b-9a28f98b5e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:44.865707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588d1c7-0368-4582-9b1b-9a28f98b5e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:44.865984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588d1c7-0368-4582-9b1b-9a28f98b5e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:44.866247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588d1c7-0368-4582-9b1b-9a28f98b5e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:44.876533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588d1c7-0368-4582-9b1b-9a28f98b5e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:44.878063 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588d1c7-0368-4582-9b1b-9a28f98b5e02 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:44.889254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1247/2479] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:45.191809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.193415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:45.208012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4781d-c21e-405d-804a-59d117ab4234 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:45.217966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:45.218931 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.219426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.220375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] PATH_INFO: `/v3/projects/5ce56080e2764277bca0e38cd2b5f18a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.222227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce56080e2764277bca0e38cd2b5f18a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:45.231008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:45.306318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce56080e2764277bca0e38cd2b5f18a', 'request_id': 'req-468aa1ad-26a7-4643-8187-8c131dbb10f0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:45.316676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce56080e2764277bca0e38cd2b5f18a', 'request_id': 'req-468aa1ad-26a7-4643-8187-8c131dbb10f0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:45.328507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce56080e2764277bca0e38cd2b5f18a', 'request_id': 'req-468aa1ad-26a7-4643-8187-8c131dbb10f0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:45.341681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] The token cache is being invalidate because project 5ce56080e2764277bca0e38cd2b5f18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:41:45.341987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:45.342619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-468aa1ad-26a7-4643-8187-8c131dbb10f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:41:45.344490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1233/2480] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:41:45 2022] DELETE /identity/v3/projects/5ce56080e2764277bca0e38cd2b5f18a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:45.349045 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbec06-6ea2-4511-a8dd-518f69d04d58 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.349389 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbec06-6ea2-4511-a8dd-518f69d04d58 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.349810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbec06-6ea2-4511-a8dd-518f69d04d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.374583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-23bbec06-6ea2-4511-a8dd-518f69d04d58 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:45.377103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-23bbec06-6ea2-4511-a8dd-518f69d04d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:45.456215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1248/2481] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:45.461024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd59de-7c30-40e7-a113-f7eb803be585 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.461478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd59de-7c30-40e7-a113-f7eb803be585 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.461772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd59de-7c30-40e7-a113-f7eb803be585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.489266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-56cd59de-7c30-40e7-a113-f7eb803be585 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:45.490558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-56cd59de-7c30-40e7-a113-f7eb803be585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:45.505405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1234/2482] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:41:45.506042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbec06-6ea2-4511-a8dd-518f69d04d58 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.516930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbec06-6ea2-4511-a8dd-518f69d04d58 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:45.526356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:45.527026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.527304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.527576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.528275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:41:45.528624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:45.531893 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:45.546732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1249/2483] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:41:45.562584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd59de-7c30-40e7-a113-f7eb803be585 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.572236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd59de-7c30-40e7-a113-f7eb803be585 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:45.577214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:45.577886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.578167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.578444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.579164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:45.581091 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:45.609118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1235/2484] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:41:45 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:41:45.613622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.627392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721b86-7f67-43e4-9e38-d5f330e5b883 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:45.637312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:45.688994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:45.689669 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.689952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.690201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.690877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:45.692903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:45.725197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1250/2485] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:41:45 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:41:45.729675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.740508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228bc9f-f966-49e9-9558-a6591eeeb95c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:45.745539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:45.746161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.746448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.746727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.747458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:45.749064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:45.759857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1236/2486] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:45.764177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.774623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900332a-0353-44a3-9264-ecaab944def2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:45.779460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46aad-fec1-41ee-91f3-73d1c2918979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:45.780087 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46aad-fec1-41ee-91f3-73d1c2918979 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.780373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46aad-fec1-41ee-91f3-73d1c2918979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.780652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46aad-fec1-41ee-91f3-73d1c2918979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.781410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd46aad-fec1-41ee-91f3-73d1c2918979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:45.783072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd46aad-fec1-41ee-91f3-73d1c2918979 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:45.795596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1251/2487] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:45.800314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.816616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597bb6-4540-406f-ab66-a634d8b0dc1b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:45.821340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:45.822046 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.822328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.822635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] PATH_INFO: `/v3/projects/a4cfa5e50c5a45ed8a7a3f60aa1bab55/users/13e10053c5e04f50a3b002b8751536b4/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.838515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cfa5e50c5a45ed8a7a3f60aa1bab55, user_id=13e10053c5e04f50a3b002b8751536b4, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:45.841183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:45.858131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1237/2488] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:41:45 2022] PUT /identity/v3/projects/a4cfa5e50c5a45ed8a7a3f60aa1bab55/users/13e10053c5e04f50a3b002b8751536b4/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:41:45.868864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949bb22-5a3e-4b5b-99d3-f3cd15ae30a2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:45.869436 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949bb22-5a3e-4b5b-99d3-f3cd15ae30a2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:45.870060 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949bb22-5a3e-4b5b-99d3-f3cd15ae30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:45.900705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8949bb22-5a3e-4b5b-99d3-f3cd15ae30a2 None None] MFA Rules not processed for user `13e10053c5e04f50a3b002b8751536b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:45.902042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8949bb22-5a3e-4b5b-99d3-f3cd15ae30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:45.970609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1252/2489] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:45.975006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:45.988908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:46.056695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720cc44-d29a-4334-b629-3166ede48ca3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:46.062416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:46.063409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.063698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.063978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.064664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:46.066744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:46.098073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1238/2490] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:41:45 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:41:46.102921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949bb22-5a3e-4b5b-99d3-f3cd15ae30a2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:46.115228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949bb22-5a3e-4b5b-99d3-f3cd15ae30a2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:46.193978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:46.194624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.194906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.195332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.196027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:46.198024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:46.222583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1253/2491] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:41:46 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:41:46.227076 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:46.239749 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd6ade-c95b-49b5-9fe4-0c331b8eee30 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:46.244961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:46.245629 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.245913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.246191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.247418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:46.249615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:46.270538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1239/2492] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:46.275405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:46.286359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879283-f356-42bc-b7f3-1a294bf3046f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:46.291603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:46.292394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.292764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.293121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] PATH_INFO: `/v3/projects/3086040719354686b4c55a2dd7c6c256/users/984e045c223b42ad9bc4b1a0b301d64e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.303291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:46.313442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3086040719354686b4c55a2dd7c6c256, user_id=984e045c223b42ad9bc4b1a0b301d64e, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:46.316261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:46.336840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1254/2493] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:41:46 2022] PUT /identity/v3/projects/3086040719354686b4c55a2dd7c6c256/users/984e045c223b42ad9bc4b1a0b301d64e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:41:46.341566 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:46.359992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3f88-96aa-401b-ba4d-5a8edc3bef53 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:46.426617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d9a4-fa4a-495d-a99b-5c08b59f3c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:46.427746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d9a4-fa4a-495d-a99b-5c08b59f3c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.428156 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d9a4-fa4a-495d-a99b-5c08b59f3c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.428525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d9a4-fa4a-495d-a99b-5c08b59f3c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.429370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d9a4-fa4a-495d-a99b-5c08b59f3c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:46.431155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d9a4-fa4a-495d-a99b-5c08b59f3c32 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:46.445332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1240/2494] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:41:46.447717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:46.459761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5417454-67b6-476e-966b-9c869fbd59f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:46.464701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:46.465413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.465702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.465991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] PATH_INFO: `/v3/projects/3086040719354686b4c55a2dd7c6c256/users/984e045c223b42ad9bc4b1a0b301d64e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.468013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3086040719354686b4c55a2dd7c6c256, user_id=984e045c223b42ad9bc4b1a0b301d64e, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:46.470754 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:46.482321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1255/2495] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:41:46 2022] PUT /identity/v3/projects/3086040719354686b4c55a2dd7c6c256/users/984e045c223b42ad9bc4b1a0b301d64e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:41:46.494065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc492-f861-4bf3-a2a3-27d1de9d0737 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.494433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc492-f861-4bf3-a2a3-27d1de9d0737 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.494808 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc492-f861-4bf3-a2a3-27d1de9d0737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.531466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5abfc492-f861-4bf3-a2a3-27d1de9d0737 None None] MFA Rules not processed for user `984e045c223b42ad9bc4b1a0b301d64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:46.532741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5abfc492-f861-4bf3-a2a3-27d1de9d0737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:46.623495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1241/2496] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:41:46.639628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:46.641531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:46.763377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ce711-e4de-4d95-af9d-f327c5213682 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:46.767679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995b358-a894-4553-a259-e78efe5d86b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:46.768647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995b358-a894-4553-a259-e78efe5d86b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:46.768873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995b358-a894-4553-a259-e78efe5d86b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:46.769153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995b358-a894-4553-a259-e78efe5d86b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:46.827602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995b358-a894-4553-a259-e78efe5d86b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:46.829008 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995b358-a894-4553-a259-e78efe5d86b8 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:46.838356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1256/2497] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:55.672574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfc492-f861-4bf3-a2a3-27d1de9d0737 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:41:55.683003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfc492-f861-4bf3-a2a3-27d1de9d0737 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:41:55.686937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027bf9-20d8-4579-b37b-3ab716162103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:41:55.687555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027bf9-20d8-4579-b37b-3ab716162103 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:55.687841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027bf9-20d8-4579-b37b-3ab716162103 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:55.688118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027bf9-20d8-4579-b37b-3ab716162103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:55.698501 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:55.702995 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027bf9-20d8-4579-b37b-3ab716162103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:41:55.704766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027bf9-20d8-4579-b37b-3ab716162103 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:41:55.716221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1242/2498] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:41:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:41:56.240479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1265-9747-4bd8-a8cb-e62f78e08a95 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:41:56.241016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1265-9747-4bd8-a8cb-e62f78e08a95 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:41:56.241016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1265-9747-4bd8-a8cb-e62f78e08a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:41:56.264325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cfdf1265-9747-4bd8-a8cb-e62f78e08a95 None None] MFA Rules not processed for user `8ed5256562974246b15e474439811df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:41:56.265596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cfdf1265-9747-4bd8-a8cb-e62f78e08a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:41:56.323535 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1257/2499] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:41:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:42:03.056695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf39b-ea4e-4500-9085-e5f6b84ce88e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.057198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf39b-ea4e-4500-9085-e5f6b84ce88e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.057342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf39b-ea4e-4500-9085-e5f6b84ce88e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.059224 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1243/2500] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:42:03.066086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e880-c59c-4eeb-afcb-64f7a5cc4e9e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.067522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e880-c59c-4eeb-afcb-64f7a5cc4e9e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.068064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e880-c59c-4eeb-afcb-64f7a5cc4e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.090234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fb88e880-c59c-4eeb-afcb-64f7a5cc4e9e None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:03.091589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fb88e880-c59c-4eeb-afcb-64f7a5cc4e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:03.101062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:03.168854 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1258/2501] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:03.178585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf39b-ea4e-4500-9085-e5f6b84ce88e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:03.181002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-092cf39b-ea4e-4500-9085-e5f6b84ce88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:03.254365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf39b-ea4e-4500-9085-e5f6b84ce88e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:03.258733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80913-d910-4935-ad41-3c175837d883 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:03.259385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80913-d910-4935-ad41-3c175837d883 service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.259670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80913-d910-4935-ad41-3c175837d883 service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.259949 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80913-d910-4935-ad41-3c175837d883 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.272944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e80913-d910-4935-ad41-3c175837d883 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:03.275141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e80913-d910-4935-ad41-3c175837d883 service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:03.294874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1244/2502] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:03.366352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3028d-e4c6-4579-aca1-73e066a85f3d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.366641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3028d-e4c6-4579-aca1-73e066a85f3d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.366933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3028d-e4c6-4579-aca1-73e066a85f3d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.368312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1259/2503] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:42:03.373121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bae6b5-55e7-4be0-901e-2489761e1277 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.373470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bae6b5-55e7-4be0-901e-2489761e1277 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.373757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bae6b5-55e7-4be0-901e-2489761e1277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.393450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-80bae6b5-55e7-4be0-901e-2489761e1277 None None] MFA Rules not processed for user `2929dcc2eee6498393466499b61d6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:03.394679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-80bae6b5-55e7-4be0-901e-2489761e1277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:03.477396 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1245/2504] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:42:03.499329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3028d-e4c6-4579-aca1-73e066a85f3d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:03.501379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4db3028d-e4c6-4579-aca1-73e066a85f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:03.521340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3028d-e4c6-4579-aca1-73e066a85f3d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:03.526086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd7448-d151-421e-a03f-ff20d71257bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:03.526950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd7448-d151-421e-a03f-ff20d71257bc service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.527263 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd7448-d151-421e-a03f-ff20d71257bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.528100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd7448-d151-421e-a03f-ff20d71257bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.538988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd7448-d151-421e-a03f-ff20d71257bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:03.540592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd7448-d151-421e-a03f-ff20d71257bc service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:03.553971 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1260/2505] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:03.663835 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73edf1-628a-416d-a054-b8889f926606 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.664131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73edf1-628a-416d-a054-b8889f926606 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.664417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73edf1-628a-416d-a054-b8889f926606 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.665969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1246/2506] 10.222.0.47 () {54 vars in 921 bytes} [Fri Jul 29 08:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 08:42:03.671767 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfd6c-7853-4bac-9eb9-e9086b2faf3e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.672055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfd6c-7853-4bac-9eb9-e9086b2faf3e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.672353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfd6c-7853-4bac-9eb9-e9086b2faf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.695209 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bcccfd6c-7853-4bac-9eb9-e9086b2faf3e None None] MFA Rules not processed for user `577eab0ae167408086ce9260a4f237e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:03.696448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bcccfd6c-7853-4bac-9eb9-e9086b2faf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:03.714765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1261/2507] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Jul 29 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:03.729439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73edf1-628a-416d-a054-b8889f926606 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:03.749584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73edf1-628a-416d-a054-b8889f926606 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:03.766845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:03.767866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:03.769231 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:03.769878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:03.788278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:03.790563 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:03.803140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1247/2508] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:42:13.689622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=34 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:13.798278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=58 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:16.982756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aef563-2aed-4b4c-bc16-35448fbafc21 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:16.983345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aef563-2aed-4b4c-bc16-35448fbafc21 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:16.983345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aef563-2aed-4b4c-bc16-35448fbafc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:17.003872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-34aef563-2aed-4b4c-bc16-35448fbafc21 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:17.005312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-34aef563-2aed-4b4c-bc16-35448fbafc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:17.071734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1262/2509] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:42:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:17.084918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:17.086422 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:17.174671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3598f5-d56d-4a75-baf9-44da5024fec5 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:17.179714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbb4b5-bd28-4eb0-b18b-27c5cdac04e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:17.180380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb4b5-bd28-4eb0-b18b-27c5cdac04e3 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:17.180712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb4b5-bd28-4eb0-b18b-27c5cdac04e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:17.180899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb4b5-bd28-4eb0-b18b-27c5cdac04e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:17.190441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbb4b5-bd28-4eb0-b18b-27c5cdac04e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:17.192052 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbb4b5-bd28-4eb0-b18b-27c5cdac04e3 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:17.202587 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1248/2510] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:42:27.062665 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=25 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:27.197433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=32 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:30.296813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aef563-2aed-4b4c-bc16-35448fbafc21 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:30.367151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aef563-2aed-4b4c-bc16-35448fbafc21 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:30.372108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:30.372778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:30.373203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:30.373517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] PATH_INFO: `/v3/users/13e10053c5e04f50a3b002b8751536b4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:30.374722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e10053c5e04f50a3b002b8751536b4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:30.376705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:30.428703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e10053c5e04f50a3b002b8751536b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:30.435489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e10053c5e04f50a3b002b8751536b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:30.444041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e10053c5e04f50a3b002b8751536b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:30.466610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e10053c5e04f50a3b002b8751536b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:30.467589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e10053c5e04f50a3b002b8751536b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:30.475977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1263/2511] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:42:30 2022] DELETE /identity/v3/users/13e10053c5e04f50a3b002b8751536b4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:30.480462 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:30.481166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:30.481166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:30.503500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:30.504736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:30.583967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1249/2512] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:42:30.594169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:30.595672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:30.671465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb42e7-722d-463a-aa78-0034a1a0bd7d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:30.675621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:30.676272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:30.676559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:30.676838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:30.692203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:30.693723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:30.710972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1264/2513] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:31.072758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:31.074255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:31.087062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b25032-0ebd-41c4-9e50-2fa1007ebb91 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:31.102613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:31.103183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:31.103474 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:31.103758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] PATH_INFO: `/v3/projects/a4cfa5e50c5a45ed8a7a3f60aa1bab55` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:31.104966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4cfa5e50c5a45ed8a7a3f60aa1bab55)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:31.106984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:31.156378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4cfa5e50c5a45ed8a7a3f60aa1bab55', 'request_id': 'req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.161925 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4cfa5e50c5a45ed8a7a3f60aa1bab55', 'request_id': 'req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.170737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4cfa5e50c5a45ed8a7a3f60aa1bab55', 'request_id': 'req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.190386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] The token cache is being invalidate because project a4cfa5e50c5a45ed8a7a3f60aa1bab55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:42:31.190695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.191347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.192905 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1250/2514] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:42:31 2022] DELETE /identity/v3/projects/a4cfa5e50c5a45ed8a7a3f60aa1bab55 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:31.197200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:31.207539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39df4df-2da0-4213-b49c-575b90413209 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:31.226149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:31.267247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:31.268089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:31.268378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:31.268655 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] PATH_INFO: `/v3/users/984e045c223b42ad9bc4b1a0b301d64e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:31.270219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=984e045c223b42ad9bc4b1a0b301d64e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:31.272230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:31.325307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984e045c223b42ad9bc4b1a0b301d64e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.331944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984e045c223b42ad9bc4b1a0b301d64e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.339994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984e045c223b42ad9bc4b1a0b301d64e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.353084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984e045c223b42ad9bc4b1a0b301d64e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.353838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0153a840-f8a2-4b98-bc9f-0d0af381a9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984e045c223b42ad9bc4b1a0b301d64e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.360243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1265/2515] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:42:31 2022] DELETE /identity/v3/users/984e045c223b42ad9bc4b1a0b301d64e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:42:31.655765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:31.657434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:31.672168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f70c9-17cd-4af5-b03b-21c12a9d4d3e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:31.740176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:31.740815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:31.741100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:31.741409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] PATH_INFO: `/v3/projects/3086040719354686b4c55a2dd7c6c256` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:31.742576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3086040719354686b4c55a2dd7c6c256)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:31.744478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:31.775358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:31.794433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3086040719354686b4c55a2dd7c6c256', 'request_id': 'req-a792fa10-be2b-4972-807b-9e8796c99f47'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.799831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3086040719354686b4c55a2dd7c6c256', 'request_id': 'req-a792fa10-be2b-4972-807b-9e8796c99f47'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.809296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3086040719354686b4c55a2dd7c6c256', 'request_id': 'req-a792fa10-be2b-4972-807b-9e8796c99f47'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.823679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] The token cache is being invalidate because project 3086040719354686b4c55a2dd7c6c256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:42:31.824008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.824696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a792fa10-be2b-4972-807b-9e8796c99f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:31.826671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1251/2516] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:42:31 2022] DELETE /identity/v3/projects/3086040719354686b4c55a2dd7c6c256 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:31.831697 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ceca-a747-4721-9e3f-456ba82349ec None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:31.831981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ceca-a747-4721-9e3f-456ba82349ec None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:31.832252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ceca-a747-4721-9e3f-456ba82349ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:31.853448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d613ceca-a747-4721-9e3f-456ba82349ec None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:31.854676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d613ceca-a747-4721-9e3f-456ba82349ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:31.921901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1266/2517] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:31.930031 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a5c5-f52c-4fdc-b58b-245f95344ec9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:31.930169 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a5c5-f52c-4fdc-b58b-245f95344ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:31.930428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a5c5-f52c-4fdc-b58b-245f95344ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:31.951562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f0e8a5c5-f52c-4fdc-b58b-245f95344ec9 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:31.953427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f0e8a5c5-f52c-4fdc-b58b-245f95344ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:31.962340 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1252/2518] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:31.966734 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ceca-a747-4721-9e3f-456ba82349ec None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:31.977200 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ceca-a747-4721-9e3f-456ba82349ec None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:31.981798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:31.982421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:31.982702 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:31.982978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:31.983708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:42:31.984009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:31.985681 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:31.997471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1267/2519] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:42:32.002053 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8a5c5-f52c-4fdc-b58b-245f95344ec9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.011692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8a5c5-f52c-4fdc-b58b-245f95344ec9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.016671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.017262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.017578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.017857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.018534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.020589 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.060413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1253/2520] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:42:32 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:32.064842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.075810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322417c-bec6-441b-8ff7-0aefc3bd3255 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.102639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:32.144994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.145670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.146051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.146591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.147852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.150484 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.179598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1268/2521] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:42:32 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:42:32.185155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.196542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2103-12f1-4657-a131-26e5e326cfd6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.201845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.202470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.202754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.203030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.203736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.205385 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.215451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1254/2522] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:32.219694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.230831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e1541-3dd6-4df3-a3df-3e470363d7b0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.235991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d26ce-63cf-4412-a85b-996018566f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.236611 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d26ce-63cf-4412-a85b-996018566f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.236907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d26ce-63cf-4412-a85b-996018566f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.237176 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d26ce-63cf-4412-a85b-996018566f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.237903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d26ce-63cf-4412-a85b-996018566f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.239515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d26ce-63cf-4412-a85b-996018566f3a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.250822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1269/2523] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:32.255199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.266051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aefc4-f290-4995-9349-8997d62728d6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.271233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.271928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.272209 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.272495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] PATH_INFO: `/v3/projects/ac2839ebea5d434495118a3fa9c2a498/users/ed1c295fc6f7408f8cdda3f93d2f5887/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.287316 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2839ebea5d434495118a3fa9c2a498, user_id=ed1c295fc6f7408f8cdda3f93d2f5887, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.289922 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.305484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1255/2524] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:42:32 2022] PUT /identity/v3/projects/ac2839ebea5d434495118a3fa9c2a498/users/ed1c295fc6f7408f8cdda3f93d2f5887/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:32.317156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553910ea-4d22-4b3b-95c5-a19e7b3389be None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.317475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553910ea-4d22-4b3b-95c5-a19e7b3389be None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.318234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553910ea-4d22-4b3b-95c5-a19e7b3389be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.346528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-553910ea-4d22-4b3b-95c5-a19e7b3389be None None] MFA Rules not processed for user `ed1c295fc6f7408f8cdda3f93d2f5887`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:32.347753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-553910ea-4d22-4b3b-95c5-a19e7b3389be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:32.412500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1270/2525] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:32.417261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.489232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f2365-53c9-4629-a35d-51815aafc323 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.495208 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.495832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.496115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.496392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.497061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.498992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.532998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1256/2526] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:42:32 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:32.537601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553910ea-4d22-4b3b-95c5-a19e7b3389be None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.548628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553910ea-4d22-4b3b-95c5-a19e7b3389be None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.606121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.606748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.607016 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.607294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.607948 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.609920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.632242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1271/2527] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:42:32 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:32.636614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.647317 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53511c1-1edd-4a95-8c29-5c2b616d4985 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.653028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.653691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.653970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.654239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.654937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.656537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.667478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1257/2528] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:32.671712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.682100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cc975-dba2-444a-82da-7837e5591e43 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.687161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.687827 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.688107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.688512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] PATH_INFO: `/v3/projects/3b34cb0acba340cba11de013fe580765/users/533f359257404786bdf32e6493b59f50/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.704003 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b34cb0acba340cba11de013fe580765, user_id=533f359257404786bdf32e6493b59f50, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.706756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.722364 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1272/2529] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:42:32 2022] PUT /identity/v3/projects/3b34cb0acba340cba11de013fe580765/users/533f359257404786bdf32e6493b59f50/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:32.726499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.736631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e454d-6a1d-4157-9ee1-1537d4be0d42 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.748672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:32.805604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb1894-c809-494a-b0c0-984da89a99b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.806149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb1894-c809-494a-b0c0-984da89a99b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.806432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb1894-c809-494a-b0c0-984da89a99b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.806712 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb1894-c809-494a-b0c0-984da89a99b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.807407 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb1894-c809-494a-b0c0-984da89a99b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.809009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb1894-c809-494a-b0c0-984da89a99b2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.820347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1258/2530] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:32.825325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.831220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:32.838751 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df9888-97d7-4e33-a3d1-63169156b037 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:32.844512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:32.845172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.845480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.845759 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] PATH_INFO: `/v3/projects/3b34cb0acba340cba11de013fe580765/users/533f359257404786bdf32e6493b59f50/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.847871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b34cb0acba340cba11de013fe580765, user_id=533f359257404786bdf32e6493b59f50, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:32.850568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:32.860939 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1273/2531] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:42:32 2022] PUT /identity/v3/projects/3b34cb0acba340cba11de013fe580765/users/533f359257404786bdf32e6493b59f50/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:32.871375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca560fa1-73cb-4b6a-b2cd-d9becae162df None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:32.871756 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca560fa1-73cb-4b6a-b2cd-d9becae162df None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:32.872043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca560fa1-73cb-4b6a-b2cd-d9becae162df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:32.902728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ca560fa1-73cb-4b6a-b2cd-d9becae162df None None] MFA Rules not processed for user `533f359257404786bdf32e6493b59f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:32.903952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca560fa1-73cb-4b6a-b2cd-d9becae162df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:32.977801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1259/2532] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:32.990400 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:32.992297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:33.052043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e4b5-c9d3-4ca6-9ae7-c74270e27695 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:33.056047 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44185-83f1-4765-b949-96808775199c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:33.056750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44185-83f1-4765-b949-96808775199c service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:33.057086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44185-83f1-4765-b949-96808775199c service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:33.057460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44185-83f1-4765-b949-96808775199c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:33.068357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f44185-83f1-4765-b949-96808775199c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:33.069921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f44185-83f1-4765-b949-96808775199c service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:33.080330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1274/2533] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:33.412914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca560fa1-73cb-4b6a-b2cd-d9becae162df None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:33.422398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca560fa1-73cb-4b6a-b2cd-d9becae162df None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:33.427744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '533f359257404786bdf32e6493b59f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b34cb0acba340cba11de013fe580765', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:33.428389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:33.428695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:33.428972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:33.429713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:42:33.430021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:33.431628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:33.443952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1260/2534] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:42:33.448126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44185-83f1-4765-b949-96808775199c service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:33.458360 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44185-83f1-4765-b949-96808775199c service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:33.463911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '533f359257404786bdf32e6493b59f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b34cb0acba340cba11de013fe580765', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:33.464529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:33.464814 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:33.465098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:33.465801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:33.467705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:33.498640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1275/2535] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:42:33 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:33.503719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:33.515402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf088-2571-4a0d-ae5a-f8e37d39a8e2 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:33.579672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '533f359257404786bdf32e6493b59f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b34cb0acba340cba11de013fe580765', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:33.580290 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:33.580573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:33.580851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:33.581602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:42:33.581909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:33.583531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:33.595809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1261/2536] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:42:33.633464 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:33.644254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc38026-c1f6-4a9d-ab71-36c8e95beb80 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:33.649059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '533f359257404786bdf32e6493b59f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b34cb0acba340cba11de013fe580765', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:33.649765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:33.650046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:33.650325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] PATH_INFO: `/v3/projects/e8445acb6e7a412c9016640b65edf558` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:33.651494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e8445acb6e7a412c9016640b65edf558)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:33.653490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:33.707090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8445acb6e7a412c9016640b65edf558', 'request_id': 'req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:33.714926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8445acb6e7a412c9016640b65edf558', 'request_id': 'req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:33.720413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8445acb6e7a412c9016640b65edf558', 'request_id': 'req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:33.731865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] The token cache is being invalidate because project e8445acb6e7a412c9016640b65edf558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:42:33.732156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:33.732937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c545a4ab-4a7f-4aec-a89f-52d0a3eac6e1 tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:33.734541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1276/2537] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:42:33 2022] DELETE /identity/v3/projects/e8445acb6e7a412c9016640b65edf558 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:33.937206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:33.939146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:33.961403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:34.011223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724f4f5-7f35-4f55-ae9f-23006c2503bc tempest-VolumeQuotaClassesTest-964893895 tempest-VolumeQuotaClassesTest-964893895-project-admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:34.072935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:34.073620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:34.073910 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:34.074173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] PATH_INFO: `/v3/users/ed1c295fc6f7408f8cdda3f93d2f5887` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:34.075850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1c295fc6f7408f8cdda3f93d2f5887)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:34.077853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:34.129001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1c295fc6f7408f8cdda3f93d2f5887'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.137327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1c295fc6f7408f8cdda3f93d2f5887'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.150877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1c295fc6f7408f8cdda3f93d2f5887'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.158747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1c295fc6f7408f8cdda3f93d2f5887'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.159376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1c295fc6f7408f8cdda3f93d2f5887'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.166001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1262/2538] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:42:33 2022] DELETE /identity/v3/users/ed1c295fc6f7408f8cdda3f93d2f5887 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:34.170772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:34.171065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:34.171346 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:34.192528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:34.193787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:34.201540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:34.202948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:34.251215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:34.257851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:34.270830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1277/2539] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:34.275414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcf404-3e97-44f2-ad6e-e6907e5bc7dc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:34.279380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:34.279564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:34.280155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:34.280508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:34.280857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:34.281439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:34.283004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:34.296772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f115e3-410e-4306-842b-691c18916ec5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:34.300998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:34.301674 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:34.301952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:34.302229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:34.315635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:34.317100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:34.327659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1278/2540] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:42:34.365077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:34.366578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:34.378223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1263/2541] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:42:34.700890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:34.702473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:34.720211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495e44-a66e-43a8-961c-645a15e3a32e service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:34.725408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:34.726005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:34.726336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:34.726710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] PATH_INFO: `/v3/projects/ac2839ebea5d434495118a3fa9c2a498` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:34.727852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2839ebea5d434495118a3fa9c2a498)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:34.729804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:34.779241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2839ebea5d434495118a3fa9c2a498', 'request_id': 'req-6b517cc9-0b1d-490d-b995-4220e6c567e5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.787609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2839ebea5d434495118a3fa9c2a498', 'request_id': 'req-6b517cc9-0b1d-490d-b995-4220e6c567e5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.795419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2839ebea5d434495118a3fa9c2a498', 'request_id': 'req-6b517cc9-0b1d-490d-b995-4220e6c567e5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.806832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] The token cache is being invalidate because project ac2839ebea5d434495118a3fa9c2a498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:42:34.807118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.807800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.809357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1279/2542] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:42:34 2022] DELETE /identity/v3/projects/ac2839ebea5d434495118a3fa9c2a498 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:34.813417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:34.824306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca579528-0e9c-49a3-a731-bcdd3e8e322a service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:34.881795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:34.882456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:34.882742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:34.883026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] PATH_INFO: `/v3/users/533f359257404786bdf32e6493b59f50` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:34.884247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=533f359257404786bdf32e6493b59f50)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:34.886241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:34.934734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533f359257404786bdf32e6493b59f50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.943613 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533f359257404786bdf32e6493b59f50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.956412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533f359257404786bdf32e6493b59f50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.964255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533f359257404786bdf32e6493b59f50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.964965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-320596a7-c7e3-4d83-bef0-2cf29ddaf8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533f359257404786bdf32e6493b59f50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:34.970976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1264/2543] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:42:34 2022] DELETE /identity/v3/users/533f359257404786bdf32e6493b59f50 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:35.251596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:35.253226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:35.270183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b517cc9-0b1d-490d-b995-4220e6c567e5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:35.333600 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:35.334248 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.334526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.334795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] PATH_INFO: `/v3/projects/3b34cb0acba340cba11de013fe580765` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.336004 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b34cb0acba340cba11de013fe580765)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:35.338186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:35.388640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b34cb0acba340cba11de013fe580765', 'request_id': 'req-f70d1174-52db-4dca-88aa-992149a8fc68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:35.397453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b34cb0acba340cba11de013fe580765', 'request_id': 'req-f70d1174-52db-4dca-88aa-992149a8fc68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:35.403310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b34cb0acba340cba11de013fe580765', 'request_id': 'req-f70d1174-52db-4dca-88aa-992149a8fc68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:35.404460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:35.416951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] The token cache is being invalidate because project 3b34cb0acba340cba11de013fe580765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:42:35.417246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:35.417965 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f70d1174-52db-4dca-88aa-992149a8fc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:35.419587 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1280/2544] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:42:35 2022] DELETE /identity/v3/projects/3b34cb0acba340cba11de013fe580765 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:35.425772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e156-36fc-4cde-a38d-84a2798c7f0d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.426040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e156-36fc-4cde-a38d-84a2798c7f0d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.426318 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e156-36fc-4cde-a38d-84a2798c7f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.435414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:35.448397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5ad5e156-36fc-4cde-a38d-84a2798c7f0d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:35.450430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5ad5e156-36fc-4cde-a38d-84a2798c7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:35.517309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1265/2545] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:35.525425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acfbe8-f8e0-4ebe-a520-c6e19c772e4e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.525714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acfbe8-f8e0-4ebe-a520-c6e19c772e4e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.525990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acfbe8-f8e0-4ebe-a520-c6e19c772e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.546703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e3acfbe8-f8e0-4ebe-a520-c6e19c772e4e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:35.547922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e3acfbe8-f8e0-4ebe-a520-c6e19c772e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:35.556141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1281/2546] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:35.560518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5e156-36fc-4cde-a38d-84a2798c7f0d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:35.570505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5e156-36fc-4cde-a38d-84a2798c7f0d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:35.575608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:35.576296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.576642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.576976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.577775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:42:35.578077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:35.579679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:35.591780 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1266/2547] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:42:35.596221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acfbe8-f8e0-4ebe-a520-c6e19c772e4e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:35.606011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acfbe8-f8e0-4ebe-a520-c6e19c772e4e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:35.611508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:35.612189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.612527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.612969 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.613740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:35.615710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:35.646961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1282/2548] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:42:35 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:35.651242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:35.662134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93274-7b48-4f3d-8b48-f8373ba295b8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:35.728564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:35.729114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.729429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.729719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.730419 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:35.732395 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:35.756813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1267/2549] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:42:35 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:42:35.761608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:35.772322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e209c8d-de4f-40d2-bdcb-6c6449aaacac admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:35.777598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:35.778262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.778538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.778807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.779507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:35.781196 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:35.794460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1283/2550] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:35.798778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:35.810626 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f4c8-579f-43fa-a552-da495b69499d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:35.817684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3b2c-73b6-4680-8203-99e78032100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:35.818320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3b2c-73b6-4680-8203-99e78032100f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.818608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3b2c-73b6-4680-8203-99e78032100f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.818875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3b2c-73b6-4680-8203-99e78032100f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.819600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3b2c-73b6-4680-8203-99e78032100f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:35.821275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3b2c-73b6-4680-8203-99e78032100f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:35.832989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1268/2551] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:35.837602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:35.848108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3818c-6c87-4a14-a0ab-cefb8e812434 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:35.852964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:35.853673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.853954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.854228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] PATH_INFO: `/v3/projects/a17e508af2c24d1aa6c0099610d8f0db/users/bf749022eb1b4191a924f3ce0446e80c/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.870538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17e508af2c24d1aa6c0099610d8f0db, user_id=bf749022eb1b4191a924f3ce0446e80c, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:35.873221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:35.889322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1284/2552] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:42:35 2022] PUT /identity/v3/projects/a17e508af2c24d1aa6c0099610d8f0db/users/bf749022eb1b4191a924f3ce0446e80c/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:35.900916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f17f-2ce5-432a-87bf-6a0636a03bb1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:35.901301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f17f-2ce5-432a-87bf-6a0636a03bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:35.901813 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f17f-2ce5-432a-87bf-6a0636a03bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:35.931214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5c79f17f-2ce5-432a-87bf-6a0636a03bb1 None None] MFA Rules not processed for user `bf749022eb1b4191a924f3ce0446e80c`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:35.932614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5c79f17f-2ce5-432a-87bf-6a0636a03bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:36.009055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:36.013137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1269/2553] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:42:36.018203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:36.082726 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c045-30dc-4410-8e04-5a743c12e8d9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:36.089043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:36.089705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.089984 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.090274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.090933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:36.093021 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:36.123041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1285/2554] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:42:36 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:36.127308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f17f-2ce5-432a-87bf-6a0636a03bb1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:36.138123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f17f-2ce5-432a-87bf-6a0636a03bb1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:36.195154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:36.195792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.196075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.196354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.197029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:36.198988 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:36.225842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1270/2555] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:42:36 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:36.227138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:36.238505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e925d64-164a-4b36-8bb6-bda6d38845fb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:36.243328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:36.243945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.244228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.244503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.245207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:36.246879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:36.257934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1286/2556] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:36.262560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:36.272917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aeb93-8315-4ceb-8b8d-51024b0df170 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:36.277823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:36.278499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.278787 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.279069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] PATH_INFO: `/v3/projects/1581dd17ef01426a891e01d5901a0453/users/60839540d45944babf3d91f4f806191e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.294188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1581dd17ef01426a891e01d5901a0453, user_id=60839540d45944babf3d91f4f806191e, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:36.296869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:36.311607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1271/2557] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:42:36 2022] PUT /identity/v3/projects/1581dd17ef01426a891e01d5901a0453/users/60839540d45944babf3d91f4f806191e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:36.315679 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:36.326585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675f072-97dc-4663-ae2c-c54cdbf24ce7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:36.401478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52ff6b-c607-489f-b834-5b274a4b8b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:36.402181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52ff6b-c607-489f-b834-5b274a4b8b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.402514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52ff6b-c607-489f-b834-5b274a4b8b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.402799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52ff6b-c607-489f-b834-5b274a4b8b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.403572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52ff6b-c607-489f-b834-5b274a4b8b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:36.405443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52ff6b-c607-489f-b834-5b274a4b8b24 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:36.411942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:36.421194 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1287/2558] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:36.422463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:36.437453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d881d4a-e490-47f2-acf1-cc381537b533 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:36.443161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:36.444112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.444468 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.444821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] PATH_INFO: `/v3/projects/1581dd17ef01426a891e01d5901a0453/users/60839540d45944babf3d91f4f806191e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.447106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1581dd17ef01426a891e01d5901a0453, user_id=60839540d45944babf3d91f4f806191e, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:36.449945 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:36.470843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1272/2559] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:42:36 2022] PUT /identity/v3/projects/1581dd17ef01426a891e01d5901a0453/users/60839540d45944babf3d91f4f806191e/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:36.474500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.474795 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.475201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.512309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] MFA Rules not processed for user `60839540d45944babf3d91f4f806191e`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:36.514064 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:36.602852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1288/2560] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:36.621679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:36.623567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:36.702569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bab1a-415e-45b1-a3b9-c6b0b4fea2db admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:36.708408 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:36.709311 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:36.709764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:36.710246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:36.789215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:36.790811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:36.800733 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1273/2561] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:42:38.216174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:38.219164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:38.300727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af6ab8-a8e9-48f3-9874-2aa68edcb5b0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:38.304562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00f41d-e1b0-4f08-b5c0-6e3d03c2f339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:38.305179 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f41d-e1b0-4f08-b5c0-6e3d03c2f339 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:38.305518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f41d-e1b0-4f08-b5c0-6e3d03c2f339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:38.305959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f41d-e1b0-4f08-b5c0-6e3d03c2f339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:38.308370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8f00f41d-e1b0-4f08-b5c0-6e3d03c2f339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:38.404709 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00f41d-e1b0-4f08-b5c0-6e3d03c2f339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:38.406326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00f41d-e1b0-4f08-b5c0-6e3d03c2f339 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:38.418541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1289/2562] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:39.422783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:39.432313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:39.497108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaf06-a7a8-4f80-b089-b159436e8d57 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:39.501722 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:39.502375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:39.502656 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:39.502933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] PATH_INFO: `/v3/users/bf749022eb1b4191a924f3ce0446e80c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:39.504152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf749022eb1b4191a924f3ce0446e80c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:39.506112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:39.567397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf749022eb1b4191a924f3ce0446e80c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:39.578789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf749022eb1b4191a924f3ce0446e80c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:39.596542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf749022eb1b4191a924f3ce0446e80c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:39.605499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf749022eb1b4191a924f3ce0446e80c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:39.606306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf749022eb1b4191a924f3ce0446e80c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:39.616644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1274/2563] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:42:39 2022] DELETE /identity/v3/users/bf749022eb1b4191a924f3ce0446e80c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:39.618766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:39.619287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:39.619387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:39.639842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:39.641258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:39.674259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:39.710073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1290/2564] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:42:39.719346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:39.720817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:39.788973 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abf27-1504-4f8c-9934-92921a57127f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:39.792952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:39.793715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:39.794059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:39.794403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:39.804411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:39.806179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:39.816829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1275/2565] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:40.097189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:40.098771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:40.111825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78b574-f34d-4552-8ee2-b95717307e72 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:40.119624 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:40.120299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:40.121066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:40.121066 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] PATH_INFO: `/v3/projects/a17e508af2c24d1aa6c0099610d8f0db` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:40.122054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17e508af2c24d1aa6c0099610d8f0db)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:40.123976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:40.175528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17e508af2c24d1aa6c0099610d8f0db', 'request_id': 'req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.183816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17e508af2c24d1aa6c0099610d8f0db', 'request_id': 'req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.189798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17e508af2c24d1aa6c0099610d8f0db', 'request_id': 'req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.201370 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] The token cache is being invalidate because project a17e508af2c24d1aa6c0099610d8f0db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:42:40.201606 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.202244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a6c77a3-6bac-4e09-a3c2-d67a4ffd415a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.204020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1291/2566] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:42:40 2022] DELETE /identity/v3/projects/a17e508af2c24d1aa6c0099610d8f0db => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:40.207838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:40.217664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac628-4190-4c7f-b084-6cec854c9e2b service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:40.395356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:40.433944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:40.434622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:40.434872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:40.435151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] PATH_INFO: `/v3/users/60839540d45944babf3d91f4f806191e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:40.436324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60839540d45944babf3d91f4f806191e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:40.438282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:40.493609 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60839540d45944babf3d91f4f806191e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.504321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60839540d45944babf3d91f4f806191e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.519849 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60839540d45944babf3d91f4f806191e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.527608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60839540d45944babf3d91f4f806191e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.528356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60839540d45944babf3d91f4f806191e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:40.534333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1276/2567] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:42:40 2022] DELETE /identity/v3/users/60839540d45944babf3d91f4f806191e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:40.800811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:40.801846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:40.802326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:40.868013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:40.869390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:40.941168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1292/2568] 10.222.0.47 () {58 vars in 967 bytes} [Fri Jul 29 08:42:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:40.954924 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:40.957115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:40.988857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:40.990415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:41.034017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:41.044412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb353d-30b9-409d-82ae-365a721791c5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.049806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.052405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.052405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.052405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] PATH_INFO: `/v3/projects/1581dd17ef01426a891e01d5901a0453` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.053677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1581dd17ef01426a891e01d5901a0453)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.056070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.098388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c29e7-8604-4f50-be18-08013183ba3f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.107702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1581dd17ef01426a891e01d5901a0453', 'request_id': 'req-8d741efc-83e4-4012-b9a9-10636f4ae91d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:41.109431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:41.115644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1581dd17ef01426a891e01d5901a0453', 'request_id': 'req-8d741efc-83e4-4012-b9a9-10636f4ae91d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:41.124132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1581dd17ef01426a891e01d5901a0453', 'request_id': 'req-8d741efc-83e4-4012-b9a9-10636f4ae91d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:41.137220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] The token cache is being invalidate because project 1581dd17ef01426a891e01d5901a0453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:42:41.137560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:41.138245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d741efc-83e4-4012-b9a9-10636f4ae91d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:42:41.140142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1277/2569] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:42:40 2022] DELETE /identity/v3/projects/1581dd17ef01426a891e01d5901a0453 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:42:41.145146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd977a8b-9cef-49e3-9f0a-7d95e935ac2f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.145558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd977a8b-9cef-49e3-9f0a-7d95e935ac2f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.145941 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd977a8b-9cef-49e3-9f0a-7d95e935ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.166156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.167212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.167212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.167429 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.168227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cd977a8b-9cef-49e3-9f0a-7d95e935ac2f None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:41.169527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:41.169759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cd977a8b-9cef-49e3-9f0a-7d95e935ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:41.249197 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1278/2570] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:42:41.256136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.256136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.256136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.267257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.269895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.282956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1293/2571] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:42:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 29 08:42:41.289189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:41.291003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:41.299698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1279/2572] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:41.309175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:41.309335 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:41.310741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:41.329999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cade7f-78db-4f2e-9ee6-17fa3cb42c19 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.336131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.336825 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.337142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.337462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.338462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:42:41.338462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.341777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.358153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1294/2573] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:42:41.362323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:41.376720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c0262-fa03-4eb8-93cd-70dcec93aa58 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.382562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.383306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.384062 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.384434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.385222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.388355 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.393179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225800-c99d-468c-9d0a-909f625f4167 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.397645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.398283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.398558 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.398829 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.400789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:41.414432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.416165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.427415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1280/2574] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:41.431646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1295/2575] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:42:41 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:41.440489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:41.453009 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379388d4-d1f8-46e2-8573-0893986d03f2 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.518578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.519401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.519912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.520512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.520970 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.522952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.550215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1281/2576] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:42:41 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:42:41.554098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:41.568952 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502b6e1-2c82-4f00-b229-2bf8ab6d8912 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.576421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.577204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.578067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.578448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.579586 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.581376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.597140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1296/2577] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:41.601082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:41.610165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:41.615174 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e73845-0bc6-41e6-b44b-8dc801f41ba4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.632078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5057-68ce-4752-a8cd-060531c8fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.632748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5057-68ce-4752-a8cd-060531c8fc0c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.633778 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5057-68ce-4752-a8cd-060531c8fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.634061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5057-68ce-4752-a8cd-060531c8fc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.635669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5057-68ce-4752-a8cd-060531c8fc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.638524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5057-68ce-4752-a8cd-060531c8fc0c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.657926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1282/2578] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:42:41.662169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:41.675455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c6844-5f44-4d25-aa87-1fd4123b177b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:41.681613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:41.682621 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.683127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.684421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] PATH_INFO: `/v3/projects/54ed442ae8db40279c489287dfe6f0b5/users/54aa33fae2a74bdaa04aa878dd4ca833/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.698459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:41.865720 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ed442ae8db40279c489287dfe6f0b5, user_id=54aa33fae2a74bdaa04aa878dd4ca833, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:41.868466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:41.891526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1297/2579] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:42:41 2022] PUT /identity/v3/projects/54ed442ae8db40279c489287dfe6f0b5/users/54aa33fae2a74bdaa04aa878dd4ca833/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:42:41.894284 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038604e9-fd68-4d14-8424-cf0520d84ad6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:41.894579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038604e9-fd68-4d14-8424-cf0520d84ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:41.894902 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038604e9-fd68-4d14-8424-cf0520d84ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:41.928588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-038604e9-fd68-4d14-8424-cf0520d84ad6 None None] MFA Rules not processed for user `54aa33fae2a74bdaa04aa878dd4ca833`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:41.929978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-038604e9-fd68-4d14-8424-cf0520d84ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:42.004023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1283/2580] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:42.016376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:42.018173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:42.075505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6d01-288c-4e15-9b58-7d65212290d9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:42.079519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:42.080151 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:42.080433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:42.080729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:42.089994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:42.091407 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:42.100373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1298/2581] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:43.471947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88459686-33c6-4695-94b0-f473790ac57b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:43.472466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88459686-33c6-4695-94b0-f473790ac57b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:43.472466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88459686-33c6-4695-94b0-f473790ac57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:43.494741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-88459686-33c6-4695-94b0-f473790ac57b None None] MFA Rules not processed for user `54aa33fae2a74bdaa04aa878dd4ca833`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:42:43.495958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88459686-33c6-4695-94b0-f473790ac57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:43.504699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1284/2582] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:42:43.544876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:42:43.546369 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:43.603791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7ece-fa69-475d-aacd-21556db48592 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:42:43.607722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:42:43.608340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:42:43.608618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:42:43.608890 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:42:43.610799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:42:43.685455 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:42:43.686919 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:42:43.698134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1299/2583] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:42:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:42:53.487266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=38 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:53.693186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:01.294717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:01.295250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:01.295250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:01.314444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:01.315631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:01.370337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1285/2584] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:43:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:01.382217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:01.383784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:01.451991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef511a77-acc4-4cb2-abac-ea6738c6a577 service glance] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:01.457843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc534d9a-aee8-47eb-94d6-7ff3138e37d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:01.458462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534d9a-aee8-47eb-94d6-7ff3138e37d6 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:01.458737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534d9a-aee8-47eb-94d6-7ff3138e37d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:01.459010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534d9a-aee8-47eb-94d6-7ff3138e37d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:01.468713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc534d9a-aee8-47eb-94d6-7ff3138e37d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:01.471077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc534d9a-aee8-47eb-94d6-7ff3138e37d6 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:01.483320 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1300/2585] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:43:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:01.721731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:01.723288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:01.785956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dca2c-1ac6-440d-870c-c771d0385095 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:01.790522 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:01.791219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:01.791510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:01.791792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:01.793921 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:01.861618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:01.863068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:01.872809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1286/2586] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:02.025961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36209-b56d-4cfd-89e8-90d8e310ba02 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:02.026230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36209-b56d-4cfd-89e8-90d8e310ba02 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:02.026538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36209-b56d-4cfd-89e8-90d8e310ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:02.046234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-54d36209-b56d-4cfd-89e8-90d8e310ba02 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:02.047328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-54d36209-b56d-4cfd-89e8-90d8e310ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:02.059973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1301/2587] 10.222.0.47 () {58 vars in 967 bytes} [Fri Jul 29 08:43:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:02.067141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:02.079366 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a05f-73a4-4d83-8edf-3c1286b27bc1 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:02.084798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:02.085470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:02.085754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:02.086004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:02.096261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:02.097909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:02.108531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1287/2588] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:43:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:02.333878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae131330-3906-4588-afd7-49495afb293f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:02.334161 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae131330-3906-4588-afd7-49495afb293f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:02.334431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae131330-3906-4588-afd7-49495afb293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:02.354660 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ae131330-3906-4588-afd7-49495afb293f None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:02.355866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ae131330-3906-4588-afd7-49495afb293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:02.363128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1302/2589] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:43:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:02.375702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:02.386603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0b8e7-2408-47df-a7aa-f1de94036a83 service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:02.392567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:02.393439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:02.393724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:02.394004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:02.404541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:02.406389 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:02.415954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1288/2590] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:43:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:02.751556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:02.752129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:02.752129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:02.772636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:02.773909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:02.788798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1303/2591] 10.222.0.47 () {58 vars in 967 bytes} [Fri Jul 29 08:43:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:02.798955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:02.810534 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f5dbc-6a99-47a1-920d-ed4ffe168818 service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:02.817216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:02.817928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:02.818218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:02.818502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:02.828405 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:02.830035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:02.839172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1289/2592] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:43:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:04.837782 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:04.839371 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:04.865860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79c32-3374-4cfa-b1d0-9937f2de3ca4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:04.871051 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:04.875159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:04.875159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:04.875614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] PATH_INFO: `/v3/users/23df9992ac7b4e89ba4dddef5b7e14a2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:04.877077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23df9992ac7b4e89ba4dddef5b7e14a2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:04.879296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:04.931150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23df9992ac7b4e89ba4dddef5b7e14a2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:04.937804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23df9992ac7b4e89ba4dddef5b7e14a2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:04.945440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23df9992ac7b4e89ba4dddef5b7e14a2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:04.957507 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23df9992ac7b4e89ba4dddef5b7e14a2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:04.958139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23df9992ac7b4e89ba4dddef5b7e14a2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:04.964086 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1304/2593] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:04 2022] DELETE /identity/v3/users/23df9992ac7b4e89ba4dddef5b7e14a2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:05.070845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.081985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2f90-9535-4a16-ae89-470f2b6239a8 service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.094296 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:05.143209 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.143727 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.144541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.144830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.145139 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.145246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] PATH_INFO: `/v3/users/54aa33fae2a74bdaa04aa878dd4ca833` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.146642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54aa33fae2a74bdaa04aa878dd4ca833)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.148963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.174539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cadb-7a1b-4aee-a717-0e346119cc4f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.180292 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.181878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.182433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.182705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] PATH_INFO: `/v3/projects/6de3e51ede7c4d6182b528d698a68b4c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.184027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de3e51ede7c4d6182b528d698a68b4c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.186504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.203791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54aa33fae2a74bdaa04aa878dd4ca833'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.211180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54aa33fae2a74bdaa04aa878dd4ca833'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.223895 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54aa33fae2a74bdaa04aa878dd4ca833'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.229757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:05.231951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54aa33fae2a74bdaa04aa878dd4ca833'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.232776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-def345e5-d230-4f28-829a-2a2469a6035a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54aa33fae2a74bdaa04aa878dd4ca833'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.239319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1290/2594] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:05 2022] DELETE /identity/v3/users/54aa33fae2a74bdaa04aa878dd4ca833 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:05.240310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de3e51ede7c4d6182b528d698a68b4c', 'request_id': 'req-ec5e06f1-3104-4e4e-901f-428dd0b88715'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.245300 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.245809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.246092 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.249820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de3e51ede7c4d6182b528d698a68b4c', 'request_id': 'req-ec5e06f1-3104-4e4e-901f-428dd0b88715'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.257528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de3e51ede7c4d6182b528d698a68b4c', 'request_id': 'req-ec5e06f1-3104-4e4e-901f-428dd0b88715'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.265837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:05.267057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.269477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] The token cache is being invalidate because project 6de3e51ede7c4d6182b528d698a68b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:05.269771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.270419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ec5e06f1-3104-4e4e-901f-428dd0b88715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.272048 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1305/2595] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:05 2022] DELETE /identity/v3/projects/6de3e51ede7c4d6182b528d698a68b4c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:05.276791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591077d-42bd-40ff-866a-319874a967fd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.277073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591077d-42bd-40ff-866a-319874a967fd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.277395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591077d-42bd-40ff-866a-319874a967fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.298637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3591077d-42bd-40ff-866a-319874a967fd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:05.299866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3591077d-42bd-40ff-866a-319874a967fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.328105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1291/2596] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:05.338067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.339536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.359985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1306/2597] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:43:05.368159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565be8c-0773-4d3a-bfc7-aa12ef32432e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.368448 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565be8c-0773-4d3a-bfc7-aa12ef32432e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.368722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565be8c-0773-4d3a-bfc7-aa12ef32432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.379167 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:05.387912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1565be8c-0773-4d3a-bfc7-aa12ef32432e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:05.389126 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1565be8c-0773-4d3a-bfc7-aa12ef32432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.397258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1307/2598] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:43:05.399676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ec30-c85d-4c0e-929d-3d19d563b994 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.401915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565be8c-0773-4d3a-bfc7-aa12ef32432e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.403851 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.404485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.404774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.405056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.411226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565be8c-0773-4d3a-bfc7-aa12ef32432e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.415030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.415772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.416404 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.416536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.416704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.416944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.417664 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:43:05.417964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.419543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.427457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1292/2599] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:43:05.433385 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1308/2600] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:43:05.435635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.445517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323ee7-d069-4f01-a79c-517e7878bdd7 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.450325 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.451306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.451593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.451907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.452602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.454542 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.484218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1293/2601] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:05.488686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.499383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90533576-b2e8-45a1-bb23-5967a5fa4a8e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.558459 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.559197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.559496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.559770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.560509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.562532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.586516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1309/2602] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:43:05.591328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.602991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b79756-0f79-43ee-81ba-a4cccbf5a815 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.608540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.608540 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.608742 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.608899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.609592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.609713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.611106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.611320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.625319 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1294/2603] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:05.625822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f2caf-8ae0-44a6-8c38-d12206c8184a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.627838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.631046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.631805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.632576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.632576 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] PATH_INFO: `/v3/projects/54ed442ae8db40279c489287dfe6f0b5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.633762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ed442ae8db40279c489287dfe6f0b5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.635899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.639547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165893b-e2c7-4d02-a569-68cdac059867 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.644648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.645152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.645504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.645737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.646435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.648142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.658574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1295/2604] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:05.662869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.671028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:05.673616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a1de-8911-462b-95b9-b8cfcc0dbeb2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.686914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ed442ae8db40279c489287dfe6f0b5', 'request_id': 'req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.695114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ed442ae8db40279c489287dfe6f0b5', 'request_id': 'req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.701178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ed442ae8db40279c489287dfe6f0b5', 'request_id': 'req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.714240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] The token cache is being invalidate because project 54ed442ae8db40279c489287dfe6f0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:05.714580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.715249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8dbb0dbb-7e3d-4c70-a2dd-bdda7262348a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:05.716816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1310/2605] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:05 2022] DELETE /identity/v3/projects/54ed442ae8db40279c489287dfe6f0b5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:43:05.721647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a630-71eb-473a-b0ad-1005f1b04410 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.721937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a630-71eb-473a-b0ad-1005f1b04410 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.722211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a630-71eb-473a-b0ad-1005f1b04410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.740488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8898a630-71eb-473a-b0ad-1005f1b04410 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:05.741346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3417f-db49-41e6-979d-dcdae54ee1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.741738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8898a630-71eb-473a-b0ad-1005f1b04410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.742035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3417f-db49-41e6-979d-dcdae54ee1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.742322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3417f-db49-41e6-979d-dcdae54ee1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.742604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3417f-db49-41e6-979d-dcdae54ee1e7 admin admin] PATH_INFO: `/v3/projects/b8e8d9fc16d74ca29abe3383240c1065/users/7ebf16015d8b4c60b816ec080b78394c/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.751656 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1311/2606] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:43:05.757721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3417f-db49-41e6-979d-dcdae54ee1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e8d9fc16d74ca29abe3383240c1065, user_id=7ebf16015d8b4c60b816ec080b78394c, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.759071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f383bfe-9db4-4aac-8699-f80538ee00f2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.759362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f383bfe-9db4-4aac-8699-f80538ee00f2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.759711 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f383bfe-9db4-4aac-8699-f80538ee00f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.760399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3417f-db49-41e6-979d-dcdae54ee1e7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.774429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1296/2607] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:05 2022] PUT /identity/v3/projects/b8e8d9fc16d74ca29abe3383240c1065/users/7ebf16015d8b4c60b816ec080b78394c/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:43:05.779020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6f383bfe-9db4-4aac-8699-f80538ee00f2 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:05.780298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6f383bfe-9db4-4aac-8699-f80538ee00f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.785753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.786042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.786323 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.814097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] MFA Rules not processed for user `7ebf16015d8b4c60b816ec080b78394c`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:05.815330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.845007 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1312/2608] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:43:05.849839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f383bfe-9db4-4aac-8699-f80538ee00f2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.858682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f383bfe-9db4-4aac-8699-f80538ee00f2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.863504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.864096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.864367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.864641 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.865392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:43:05.865704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.867286 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.879017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1313/2609] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:43:05.883309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.884628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1297/2610] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:43:05.888834 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.890803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:05.893189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bee3b-2170-44ab-92d4-fd3ad0f2bb13 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.897950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.898549 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.898828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.899102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.899761 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.901792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.904406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e87adb-b158-4785-bd55-f7d57d92295f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:05.909087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:05.909751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:05.910029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:05.910301 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:05.910977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:05.912844 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:05.917654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:05.931090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1314/2611] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:43:05.935604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.945083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1298/2612] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:43:05.946013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:05.996811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cfaa7-0f23-4c4f-a8cb-b6d098175749 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.006713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11826dc-fa0d-445a-9f50-3398ef828f7a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.012106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.012800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.013078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.013894 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.014562 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.016528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.016865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:06.040126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1299/2613] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:43:06.043965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.053514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909de7d-1563-4419-8933-43ba4b61a03d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.058216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.058809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.059089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.059358 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.059654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.060045 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.060287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.060569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.060842 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.061573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.061696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.063521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.071529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1300/2614] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:43:06.075944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.086526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fad4fe-21fb-4de7-bce3-b76b4e8baa4d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.091639 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1315/2615] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:05 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:43:06.092801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.093420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.094099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.094376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.094683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] PATH_INFO: `/v3/projects/686c168f38854b30becf4f33a68f31f5/users/a31de4de0ccf4d3295c684ac23ca9f24/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.104044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2deb2-0c47-4197-8e6e-f5bcf48d3c47 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.109714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.110336 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.110617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.110901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.111750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.112893 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686c168f38854b30becf4f33a68f31f5, user_id=a31de4de0ccf4d3295c684ac23ca9f24, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.113497 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.115607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.124402 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1316/2616] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:43:06.128732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.130486 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1301/2617] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:06 2022] PUT /identity/v3/projects/686c168f38854b30becf4f33a68f31f5/users/a31de4de0ccf4d3295c684ac23ca9f24/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:43:06.134150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.138756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cefe8-e5ac-4660-8c00-ec20cf54cc2b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.195809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cfd5e-2465-4aef-a67c-541f6e96e233 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.196687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.197396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.197677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.198059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.198753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.200350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.201380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.202288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.202638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.203298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.204068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.205767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.210705 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1317/2618] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:43:06.215181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.217784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1302/2619] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:43:06.220634 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.225968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99dcac-53fb-49a4-818a-a4d534c27a4b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.230428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997173c1-9f8d-4d27-843d-910203be281d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.230658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec070ae9-4d8b-4427-9b27-d0cedd1f8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.231324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070ae9-4d8b-4427-9b27-d0cedd1f8f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.231603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070ae9-4d8b-4427-9b27-d0cedd1f8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.231876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070ae9-4d8b-4427-9b27-d0cedd1f8f32 admin admin] PATH_INFO: `/v3/projects/435bbf15e66047559683c9233ff6bf4b/users/b54e78963f6e454db76e2d7477f120fd/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.235579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477309e7-c33f-47f1-aa2d-aba710822031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.236314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477309e7-c33f-47f1-aa2d-aba710822031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.236690 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477309e7-c33f-47f1-aa2d-aba710822031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.237023 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477309e7-c33f-47f1-aa2d-aba710822031 admin admin] PATH_INFO: `/v3/projects/686c168f38854b30becf4f33a68f31f5/users/a31de4de0ccf4d3295c684ac23ca9f24/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.239096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477309e7-c33f-47f1-aa2d-aba710822031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686c168f38854b30becf4f33a68f31f5, user_id=a31de4de0ccf4d3295c684ac23ca9f24, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.241884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477309e7-c33f-47f1-aa2d-aba710822031 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.247398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec070ae9-4d8b-4427-9b27-d0cedd1f8f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435bbf15e66047559683c9233ff6bf4b, user_id=b54e78963f6e454db76e2d7477f120fd, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.250211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec070ae9-4d8b-4427-9b27-d0cedd1f8f32 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.260426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1303/2620] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:06 2022] PUT /identity/v3/projects/686c168f38854b30becf4f33a68f31f5/users/a31de4de0ccf4d3295c684ac23ca9f24/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:43:06.264098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1318/2621] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:06 2022] PUT /identity/v3/projects/435bbf15e66047559683c9233ff6bf4b/users/b54e78963f6e454db76e2d7477f120fd/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:06.272146 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.272443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.272754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.273974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.274262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.274540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.301574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] MFA Rules not processed for user `a31de4de0ccf4d3295c684ac23ca9f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:06.301819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] MFA Rules not processed for user `b54e78963f6e454db76e2d7477f120fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:06.302825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:06.302986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:06.312213 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:06.368527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1319/2622] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:43:06.375281 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1304/2623] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:43:06.381805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.383204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:06.386440 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.387950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:06.389895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:06.446885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5689c-7a5c-4a3b-8263-e37aa0c91716 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.449467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08985-c639-4307-8d7b-72a237c01076 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.451901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.452543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.452822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.453096 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.455359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.456118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.456402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.456676 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.462103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.463562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.467644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.469065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.472438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1320/2624] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:06.478646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1305/2625] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:43:06.558462 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:06.566936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23533777-1d52-4054-90e9-8193e7abd216 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:06.570683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c15c1d-514f-47d2-a592-91a9aab6973d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:06.571294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c15c1d-514f-47d2-a592-91a9aab6973d service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:06.571573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c15c1d-514f-47d2-a592-91a9aab6973d service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:06.571847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c15c1d-514f-47d2-a592-91a9aab6973d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:06.634232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c15c1d-514f-47d2-a592-91a9aab6973d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:06.635891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c15c1d-514f-47d2-a592-91a9aab6973d service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:06.645765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1321/2626] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:16.474293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=50 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:16.641950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=52 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:29.249176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:29.322588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f61f4-7207-40be-9956-cdb90f1477ab service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:29.328507 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:29.329085 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:29.329397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:29.329670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] PATH_INFO: `/v3/users/7ebf16015d8b4c60b816ec080b78394c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:29.330958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ebf16015d8b4c60b816ec080b78394c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:29.332948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:29.381664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ebf16015d8b4c60b816ec080b78394c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:29.390140 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ebf16015d8b4c60b816ec080b78394c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:29.402145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ebf16015d8b4c60b816ec080b78394c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:29.408969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ebf16015d8b4c60b816ec080b78394c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:29.409614 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ebf16015d8b4c60b816ec080b78394c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:29.415456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1306/2627] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:29 2022] DELETE /identity/v3/users/7ebf16015d8b4c60b816ec080b78394c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:29.420026 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:29.420542 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:29.420653 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:29.439430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:29.440623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:29.499309 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1322/2628] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:29.509275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:29.510732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:29.574261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9fd96-2585-418a-a69d-0127d309cf73 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:29.579027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:29.579579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:29.579862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:29.580128 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:29.591574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:29.593795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:29.605132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1307/2629] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:43:29.881788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:29.883380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:29.897392 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7352-9e52-44cb-a56e-b146ef44a79d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:29.903077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:29.903733 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:29.904011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:29.904275 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] PATH_INFO: `/v3/projects/b8e8d9fc16d74ca29abe3383240c1065` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:29.906260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e8d9fc16d74ca29abe3383240c1065)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:29.908739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:29.975300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e8d9fc16d74ca29abe3383240c1065', 'request_id': 'req-324bc29e-7f14-46cc-8f1d-6d857993ea80'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:29.985271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e8d9fc16d74ca29abe3383240c1065', 'request_id': 'req-324bc29e-7f14-46cc-8f1d-6d857993ea80'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:29.990739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e8d9fc16d74ca29abe3383240c1065', 'request_id': 'req-324bc29e-7f14-46cc-8f1d-6d857993ea80'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.002883 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] The token cache is being invalidate because project b8e8d9fc16d74ca29abe3383240c1065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:30.003172 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.003892 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.005550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1323/2630] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:29 2022] DELETE /identity/v3/projects/b8e8d9fc16d74ca29abe3383240c1065 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:30.009695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:30.019499 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c22ca-d493-4124-a883-abb9ff12bea9 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:30.041821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:30.083107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:30.083799 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.084084 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.084362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] PATH_INFO: `/v3/users/a31de4de0ccf4d3295c684ac23ca9f24` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.085715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31de4de0ccf4d3295c684ac23ca9f24)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:30.087706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:30.146112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31de4de0ccf4d3295c684ac23ca9f24'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.155450 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31de4de0ccf4d3295c684ac23ca9f24'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.173217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31de4de0ccf4d3295c684ac23ca9f24'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.180775 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31de4de0ccf4d3295c684ac23ca9f24'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.181552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-24696a76-f476-45d9-98b5-00167bf84d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31de4de0ccf4d3295c684ac23ca9f24'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.188120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1308/2631] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:30 2022] DELETE /identity/v3/users/a31de4de0ccf4d3295c684ac23ca9f24 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:30.468215 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:30.469747 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:30.483314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bc29e-7f14-46cc-8f1d-6d857993ea80 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:30.540572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:30.541208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.541532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.541756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] PATH_INFO: `/v3/projects/686c168f38854b30becf4f33a68f31f5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.542962 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686c168f38854b30becf4f33a68f31f5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:30.544897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:30.587905 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:30.607618 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686c168f38854b30becf4f33a68f31f5', 'request_id': 'req-8ba586cb-866a-426c-b2b4-f7c528c8ad99'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.615852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686c168f38854b30becf4f33a68f31f5', 'request_id': 'req-8ba586cb-866a-426c-b2b4-f7c528c8ad99'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.621816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686c168f38854b30becf4f33a68f31f5', 'request_id': 'req-8ba586cb-866a-426c-b2b4-f7c528c8ad99'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.632690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] The token cache is being invalidate because project 686c168f38854b30becf4f33a68f31f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:30.632993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.633722 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ba586cb-866a-426c-b2b4-f7c528c8ad99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:30.635244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1324/2632] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:30 2022] DELETE /identity/v3/projects/686c168f38854b30becf4f33a68f31f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:30.640461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a0012-3111-4efb-ac0b-c7680b9f39ec None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.640981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a0012-3111-4efb-ac0b-c7680b9f39ec None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.641122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a0012-3111-4efb-ac0b-c7680b9f39ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.660684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c91a0012-3111-4efb-ac0b-c7680b9f39ec None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:30.661993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c91a0012-3111-4efb-ac0b-c7680b9f39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:30.724377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1309/2633] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:30.732339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccc01-3dcf-496c-adf2-acdd854e3516 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.732623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccc01-3dcf-496c-adf2-acdd854e3516 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.732895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccc01-3dcf-496c-adf2-acdd854e3516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.753623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-667ccc01-3dcf-496c-adf2-acdd854e3516 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:30.754848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-667ccc01-3dcf-496c-adf2-acdd854e3516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:30.763609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1325/2634] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:30.767989 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a0012-3111-4efb-ac0b-c7680b9f39ec None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:30.778371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a0012-3111-4efb-ac0b-c7680b9f39ec None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:30.784280 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:30.784926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.785207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.785524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.786221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:43:30.786533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:30.788123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:30.800359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1310/2635] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:43:30.804850 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ccc01-3dcf-496c-adf2-acdd854e3516 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:30.815114 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ccc01-3dcf-496c-adf2-acdd854e3516 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:30.821609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:30.822228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.822505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.822766 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.823433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:30.825379 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:30.856311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1326/2636] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:30 2022] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:30.861065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:30.872222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44f12-61ca-42b1-9685-51603bc91fbd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:30.900668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:30.932536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:30.933090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.933411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.933694 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.934362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:30.936287 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:30.958243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1311/2637] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:30 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:30.962430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:30.972785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0dc3-d369-4a89-913c-c2fb5a2a1950 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:30.979175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:30.979934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:30.980212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:30.980483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:30.981607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:30.983543 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:30.993616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1327/2638] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:30.997659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.007936 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7ac3-0cb4-48bb-9e59-b33cf83aed6f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.013420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1de20-c117-44fd-9d0d-8f10d5006861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.014034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1de20-c117-44fd-9d0d-8f10d5006861 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.014324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1de20-c117-44fd-9d0d-8f10d5006861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.014606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1de20-c117-44fd-9d0d-8f10d5006861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.015309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1de20-c117-44fd-9d0d-8f10d5006861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.016918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1de20-c117-44fd-9d0d-8f10d5006861 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.027489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1312/2639] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:43:31.031425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.041238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a85e91-7439-48a9-9b77-cc6a4403c4e3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.045921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.046581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.046858 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.047132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] PATH_INFO: `/v3/projects/de0e0422bf334039b34b2de8e4aaaddd/users/f49392b8292e478599ca651c80c64acd/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.062490 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0e0422bf334039b34b2de8e4aaaddd, user_id=f49392b8292e478599ca651c80c64acd, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.067658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.080428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1328/2640] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:31 2022] PUT /identity/v3/projects/de0e0422bf334039b34b2de8e4aaaddd/users/f49392b8292e478599ca651c80c64acd/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:31.091020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f7018-d3e0-4fd3-a9b1-3cf6395aed1d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.091344 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f7018-d3e0-4fd3-a9b1-3cf6395aed1d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.091689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f7018-d3e0-4fd3-a9b1-3cf6395aed1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.120797 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c75f7018-d3e0-4fd3-a9b1-3cf6395aed1d None None] MFA Rules not processed for user `f49392b8292e478599ca651c80c64acd`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:31.122105 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c75f7018-d3e0-4fd3-a9b1-3cf6395aed1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:31.190670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1313/2641] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:31.195253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.256753 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5ff99-268a-47ad-9cea-1773bb6392c2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.262695 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.263317 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.263598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.263865 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.264540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.266494 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.300065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1329/2642] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:31 2022] POST /identity/v3/projects => generated 409 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:31.304435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f7018-d3e0-4fd3-a9b1-3cf6395aed1d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.315714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f7018-d3e0-4fd3-a9b1-3cf6395aed1d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.376887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.377555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.377837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.378113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.378876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.380825 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.409572 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1314/2643] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:31 2022] POST /identity/v3/users => generated 311 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:31.411169 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.421503 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d37c5-5030-44f1-ad69-e6862344716f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.426765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.427652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.427993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.428321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.429028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.430999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.444696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1330/2644] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:31.449002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.460444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab47c6-593e-4126-8683-40488eb820ff admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.467531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.468216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.468515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.468792 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] PATH_INFO: `/v3/projects/79007417683348eda27592211b18bb56/users/8133df4b0eaa45a083c0f83951ec49ac/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.489961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79007417683348eda27592211b18bb56, user_id=8133df4b0eaa45a083c0f83951ec49ac, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.494710 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.512984 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1315/2645] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:31 2022] PUT /identity/v3/projects/79007417683348eda27592211b18bb56/users/8133df4b0eaa45a083c0f83951ec49ac/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:43:31.517784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.529073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fd8e1-a95b-4800-a94a-5c6d8f325dda admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.550732 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:31.598465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c401a2e-a2e6-4bba-9763-347cc06024a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.599135 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401a2e-a2e6-4bba-9763-347cc06024a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.599417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401a2e-a2e6-4bba-9763-347cc06024a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.599693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401a2e-a2e6-4bba-9763-347cc06024a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.600424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c401a2e-a2e6-4bba-9763-347cc06024a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.602069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c401a2e-a2e6-4bba-9763-347cc06024a3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.612260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1331/2646] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:31.617199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.623078 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:31.630438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1babaf-68b9-42fd-85da-d833df3a948c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.636309 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.636979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.637259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.637569 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] PATH_INFO: `/v3/projects/79007417683348eda27592211b18bb56/users/8133df4b0eaa45a083c0f83951ec49ac/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.639753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] RBAC: Authorizing `identity:create_grant(project_id=79007417683348eda27592211b18bb56, user_id=8133df4b0eaa45a083c0f83951ec49ac, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.642439 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.653753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1316/2647] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:31 2022] PUT /identity/v3/projects/79007417683348eda27592211b18bb56/users/8133df4b0eaa45a083c0f83951ec49ac/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:31.665044 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93a65-3aed-4524-91ff-a8b0363a50d5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.665361 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93a65-3aed-4524-91ff-a8b0363a50d5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.665640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93a65-3aed-4524-91ff-a8b0363a50d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.694153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6ed93a65-3aed-4524-91ff-a8b0363a50d5 None None] MFA Rules not processed for user `8133df4b0eaa45a083c0f83951ec49ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:31.695425 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6ed93a65-3aed-4524-91ff-a8b0363a50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:31.777300 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1332/2648] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:31.788332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:31.790441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:31.853104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179b7f-303d-46b1-ba2c-a384da5876de admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:31.857208 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:31.857854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:31.858133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:31.858410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:31.867986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:31.869438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:31.878838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1317/2649] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:31 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:32.041463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed93a65-3aed-4524-91ff-a8b0363a50d5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:32.051938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed93a65-3aed-4524-91ff-a8b0363a50d5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:32.056380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579812-32bd-4df6-848f-5e85d8c0ff8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:32.056999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579812-32bd-4df6-848f-5e85d8c0ff8a service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:32.057299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579812-32bd-4df6-848f-5e85d8c0ff8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:32.057580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579812-32bd-4df6-848f-5e85d8c0ff8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:32.117398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579812-32bd-4df6-848f-5e85d8c0ff8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:32.118840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579812-32bd-4df6-848f-5e85d8c0ff8a service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:32.128562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1333/2650] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:32.211511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:32.213118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:32.283242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfad42-604a-42bf-8548-0907c49f9cc4 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:32.288681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:32.289370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:32.289654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:32.289928 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] PATH_INFO: `/v3/users/b54e78963f6e454db76e2d7477f120fd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:32.291182 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54e78963f6e454db76e2d7477f120fd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:32.293315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:32.344545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54e78963f6e454db76e2d7477f120fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.352069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54e78963f6e454db76e2d7477f120fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.364983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54e78963f6e454db76e2d7477f120fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.372237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54e78963f6e454db76e2d7477f120fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.372929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54e78963f6e454db76e2d7477f120fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.378876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1318/2651] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:32 2022] DELETE /identity/v3/users/b54e78963f6e454db76e2d7477f120fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:32.384001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:32.384378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:32.384743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:32.421479 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:32.422684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:32.467529 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:32.487307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1334/2652] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:32.497199 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:32.498642 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:32.512659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:32.560170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae819-882f-4419-ad4c-335b6d7e9012 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:32.564321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:32.565005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:32.565310 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:32.565605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:32.575160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:32.576979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:32.586531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1319/2653] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:32.872083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:32.873651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:32.886241 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405d786-e691-4c53-b18e-7a030b364e12 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:32.891100 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:32.891781 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:32.892077 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:32.892350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] PATH_INFO: `/v3/projects/435bbf15e66047559683c9233ff6bf4b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:32.893571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] RBAC: Authorizing `identity:delete_project(project_id=435bbf15e66047559683c9233ff6bf4b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:32.895530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:32.954603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435bbf15e66047559683c9233ff6bf4b', 'request_id': 'req-16724cba-dfa9-48fb-b030-47d3f1bb074f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.964240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435bbf15e66047559683c9233ff6bf4b', 'request_id': 'req-16724cba-dfa9-48fb-b030-47d3f1bb074f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.969982 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435bbf15e66047559683c9233ff6bf4b', 'request_id': 'req-16724cba-dfa9-48fb-b030-47d3f1bb074f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.980852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] The token cache is being invalidate because project 435bbf15e66047559683c9233ff6bf4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:32.981138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.981804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16724cba-dfa9-48fb-b030-47d3f1bb074f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:32.983328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1335/2654] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:32 2022] DELETE /identity/v3/projects/435bbf15e66047559683c9233ff6bf4b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:43:40.638192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:40.639758 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:40.653517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5c1d5-5f81-46db-8dbc-87d327de1d3f service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:40.712537 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:40.713183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:40.713470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:40.713785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] PATH_INFO: `/v3/users/f49392b8292e478599ca651c80c64acd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:40.715043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49392b8292e478599ca651c80c64acd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:40.717029 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:40.766306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49392b8292e478599ca651c80c64acd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:40.775952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49392b8292e478599ca651c80c64acd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:40.788263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49392b8292e478599ca651c80c64acd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:40.795574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49392b8292e478599ca651c80c64acd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:40.796239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49392b8292e478599ca651c80c64acd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:40.802441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1320/2655] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:40 2022] DELETE /identity/v3/users/f49392b8292e478599ca651c80c64acd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:40.807156 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:40.807629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:40.807750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:40.828262 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:40.829504 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:40.891359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1336/2656] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:40.901255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:40.902855 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:40.938580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:40.963672 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf279-4a7a-4c46-befa-bea3082ef11f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:40.967576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:40.968196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:40.968482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:40.968762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:40.980481 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:40.981982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:40.991538 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1321/2657] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:41.274906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:41.276388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:41.288442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22111ca-c8d9-454f-a99b-9482c6a0694c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:41.294778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:41.295452 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:41.295807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:41.296137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] PATH_INFO: `/v3/projects/de0e0422bf334039b34b2de8e4aaaddd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:41.297416 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0e0422bf334039b34b2de8e4aaaddd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:41.299367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:41.351978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0e0422bf334039b34b2de8e4aaaddd', 'request_id': 'req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.362398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0e0422bf334039b34b2de8e4aaaddd', 'request_id': 'req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.367530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:41.368777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0e0422bf334039b34b2de8e4aaaddd', 'request_id': 'req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.382608 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] The token cache is being invalidate because project de0e0422bf334039b34b2de8e4aaaddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:41.382896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.383716 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.385485 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1337/2658] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:41 2022] DELETE /identity/v3/projects/de0e0422bf334039b34b2de8e4aaaddd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:41.390051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:41.402654 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84685ad-4c94-4566-b36f-0dc2454bfcc7 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:41.471702 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:41.472352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:41.472637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:41.472918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] PATH_INFO: `/v3/users/8133df4b0eaa45a083c0f83951ec49ac` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:41.474138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8133df4b0eaa45a083c0f83951ec49ac)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:41.476064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:41.524688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8133df4b0eaa45a083c0f83951ec49ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.533658 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8133df4b0eaa45a083c0f83951ec49ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.545947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8133df4b0eaa45a083c0f83951ec49ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.552824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8133df4b0eaa45a083c0f83951ec49ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.553500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a5b35d6-cb0e-4958-86af-0f8a9d9f6201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8133df4b0eaa45a083c0f83951ec49ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.559420 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1322/2659] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:41 2022] DELETE /identity/v3/users/8133df4b0eaa45a083c0f83951ec49ac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:41.842307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:41.843877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:41.857428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee4162-a8d0-4e7c-acb6-1e1f3669fc55 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:41.915001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:41.915568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:41.915849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:41.916117 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] PATH_INFO: `/v3/projects/79007417683348eda27592211b18bb56` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:41.917427 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79007417683348eda27592211b18bb56)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:41.919384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:41.969546 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79007417683348eda27592211b18bb56', 'request_id': 'req-8255c957-c409-4f68-b0c7-1beb1e30f082'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.978023 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79007417683348eda27592211b18bb56', 'request_id': 'req-8255c957-c409-4f68-b0c7-1beb1e30f082'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.986081 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79007417683348eda27592211b18bb56', 'request_id': 'req-8255c957-c409-4f68-b0c7-1beb1e30f082'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.998635 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] The token cache is being invalidate because project 79007417683348eda27592211b18bb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:41.998925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:41.999690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8255c957-c409-4f68-b0c7-1beb1e30f082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:42.001195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1338/2660] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:41 2022] DELETE /identity/v3/projects/79007417683348eda27592211b18bb56 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:42.006444 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009a6f7-6b8b-4608-a2c9-1c68b768c84d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.006917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009a6f7-6b8b-4608-a2c9-1c68b768c84d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.007015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009a6f7-6b8b-4608-a2c9-1c68b768c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.028308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e009a6f7-6b8b-4608-a2c9-1c68b768c84d None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:42.029574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e009a6f7-6b8b-4608-a2c9-1c68b768c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:42.085946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:42.103632 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1323/2661] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:42.112489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89da05-2c71-4bef-9b46-ea4768e7bb33 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.112846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89da05-2c71-4bef-9b46-ea4768e7bb33 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.113201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89da05-2c71-4bef-9b46-ea4768e7bb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.137148 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5e89da05-2c71-4bef-9b46-ea4768e7bb33 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:42.139182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5e89da05-2c71-4bef-9b46-ea4768e7bb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:42.148419 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1339/2662] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:42.153038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009a6f7-6b8b-4608-a2c9-1c68b768c84d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.163055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009a6f7-6b8b-4608-a2c9-1c68b768c84d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.169338 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.169907 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.170190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.170464 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.171171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:43:42.171478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.173116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.185015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1324/2663] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:43:42.189232 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89da05-2c71-4bef-9b46-ea4768e7bb33 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.198420 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89da05-2c71-4bef-9b46-ea4768e7bb33 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.204359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.204968 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.205246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.205547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.206214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.208118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.238811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1340/2664] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:42 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:43:42.243876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.254262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c346-50a8-451f-b7e3-300391be38ce admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.311510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.312132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.312415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.312698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.313390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.315299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.341545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1325/2665] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:42 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:42.345999 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.360043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2fa61-d82f-4eb8-a3a6-8e1e650ed398 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.365571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.366187 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.366467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.366736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.367463 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.369094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.379699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1341/2666] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:42.384025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.394386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3503-236b-490b-9a7b-445c46c0f81d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.399292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863f34f-2557-493e-b343-beaef33d3be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.399900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f34f-2557-493e-b343-beaef33d3be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.400185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f34f-2557-493e-b343-beaef33d3be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.400467 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f34f-2557-493e-b343-beaef33d3be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.401598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863f34f-2557-493e-b343-beaef33d3be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.402822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863f34f-2557-493e-b343-beaef33d3be7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.413478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1326/2667] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:42.417595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.429607 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a26c2-5ebf-41a6-b01a-72fef93dca6d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.435374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.436072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.436358 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.436629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] PATH_INFO: `/v3/projects/5d5f821b12be497a9dd7cf0f31d42fcc/users/05acaf6d065347a0a51596404dc9e48c/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.451849 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5f821b12be497a9dd7cf0f31d42fcc, user_id=05acaf6d065347a0a51596404dc9e48c, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.454517 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.470166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1342/2668] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:42 2022] PUT /identity/v3/projects/5d5f821b12be497a9dd7cf0f31d42fcc/users/05acaf6d065347a0a51596404dc9e48c/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:42.480709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db730dc4-45c3-4245-9da9-2989a7778d4b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.481004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db730dc4-45c3-4245-9da9-2989a7778d4b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.481298 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db730dc4-45c3-4245-9da9-2989a7778d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.510811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-db730dc4-45c3-4245-9da9-2989a7778d4b None None] MFA Rules not processed for user `05acaf6d065347a0a51596404dc9e48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:42.512066 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db730dc4-45c3-4245-9da9-2989a7778d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:42.582212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1327/2669] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:42.586810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.606580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:42.655477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283a5c-3e96-4f30-ac70-a1fee6b88ce9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.660878 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.661524 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.661815 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.662094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.662757 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.664676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.697800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1343/2670] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:42 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:42.702322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db730dc4-45c3-4245-9da9-2989a7778d4b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.713781 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db730dc4-45c3-4245-9da9-2989a7778d4b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.761832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:42.773151 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.773811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.774098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.774378 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.775144 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.777160 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.798368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1328/2671] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:42 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:42.802570 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.813433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf2ad0-6f35-41b6-b62e-4efb71e1989c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.818941 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.819547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.819828 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.820099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.820799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.822467 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.833939 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1344/2672] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:42.838175 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.848776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b4db5-c04c-4a1f-8a79-282083f5c463 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.855877 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.856535 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.856817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.857088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] PATH_INFO: `/v3/projects/88eaf32ea99d431684235a5edef4a654/users/e769ed9aef834ac8b731d5a5c3a5fbdd/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.873675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88eaf32ea99d431684235a5edef4a654, user_id=e769ed9aef834ac8b731d5a5c3a5fbdd, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.876428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.892067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1329/2673] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:42 2022] PUT /identity/v3/projects/88eaf32ea99d431684235a5edef4a654/users/e769ed9aef834ac8b731d5a5c3a5fbdd/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:42.896057 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.906993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e10bf-c666-4530-92b1-4675e922a306 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:42.966692 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3f1c-c8c9-4b29-8d0f-1285d1c76a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:42.967253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3f1c-c8c9-4b29-8d0f-1285d1c76a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:42.967532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3f1c-c8c9-4b29-8d0f-1285d1c76a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:42.967809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3f1c-c8c9-4b29-8d0f-1285d1c76a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:42.968488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3f1c-c8c9-4b29-8d0f-1285d1c76a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:42.970130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3f1c-c8c9-4b29-8d0f-1285d1c76a91 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:42.980090 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1345/2674] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:42.984456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:42.995688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d1212-2b13-4743-bf37-a3dacb0f042f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:43.000961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:43.001700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:43.001985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:43.002263 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] PATH_INFO: `/v3/projects/88eaf32ea99d431684235a5edef4a654/users/e769ed9aef834ac8b731d5a5c3a5fbdd/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:43.004484 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88eaf32ea99d431684235a5edef4a654, user_id=e769ed9aef834ac8b731d5a5c3a5fbdd, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:43.007302 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:43.018819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1330/2675] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:42 2022] PUT /identity/v3/projects/88eaf32ea99d431684235a5edef4a654/users/e769ed9aef834ac8b731d5a5c3a5fbdd/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:43.090183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a836c-d957-4782-86ac-21a332ebd7af None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:43.090650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a836c-d957-4782-86ac-21a332ebd7af None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:43.091055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a836c-d957-4782-86ac-21a332ebd7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:43.127260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e41a836c-d957-4782-86ac-21a332ebd7af None None] MFA Rules not processed for user `e769ed9aef834ac8b731d5a5c3a5fbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:43.128496 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e41a836c-d957-4782-86ac-21a332ebd7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:43.200629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1346/2676] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:43.212805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:43.214879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:43.276961 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b02f67-7e59-412b-9799-5410830da3e0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:43.281415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:43.282047 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:43.282330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:43.282645 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:43.291882 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:43.293313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:43.302946 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1331/2677] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:43.399198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a836c-d957-4782-86ac-21a332ebd7af None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:43.410110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a836c-d957-4782-86ac-21a332ebd7af None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:43.414011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d5ad4-1635-42ff-ade9-734c4ac6dbf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:43.414628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d5ad4-1635-42ff-ade9-734c4ac6dbf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:43.414908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d5ad4-1635-42ff-ade9-734c4ac6dbf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:43.415181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d5ad4-1635-42ff-ade9-734c4ac6dbf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:43.425189 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:43.475673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d5ad4-1635-42ff-ade9-734c4ac6dbf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:43.477123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d5ad4-1635-42ff-ade9-734c4ac6dbf9 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:43.486140 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1347/2678] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:43.768760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:43.833861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3906c8-9a12-4a05-89f5-6386cf1faa35 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:43.839411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:43.840051 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:43.840356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:43.840599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] PATH_INFO: `/v3/users/05acaf6d065347a0a51596404dc9e48c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:43.841887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05acaf6d065347a0a51596404dc9e48c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:43.843822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:43.893862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05acaf6d065347a0a51596404dc9e48c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:43.895541 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:43.903206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05acaf6d065347a0a51596404dc9e48c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:43.915833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05acaf6d065347a0a51596404dc9e48c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:43.923269 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05acaf6d065347a0a51596404dc9e48c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:43.923917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05acaf6d065347a0a51596404dc9e48c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:43.930061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1332/2679] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:43 2022] DELETE /identity/v3/users/05acaf6d065347a0a51596404dc9e48c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:43.934855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:43.935328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:43.935426 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:43.955405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:43.956598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:44.018796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1348/2680] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:44.028748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:44.030253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:44.088846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4486-6826-483f-b039-5a09ee4d0ef1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:44.093824 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:44.094826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:44.095329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:44.095810 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:44.109987 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:44.111432 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:44.121354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1333/2681] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:44.402157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:44.403649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:44.419067 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221af5-4370-4ca2-ac21-01d6e7ce2b97 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:44.424488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:44.425303 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:44.425626 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:44.425818 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] PATH_INFO: `/v3/projects/5d5f821b12be497a9dd7cf0f31d42fcc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:44.427434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5f821b12be497a9dd7cf0f31d42fcc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:44.429566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:44.480630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5f821b12be497a9dd7cf0f31d42fcc', 'request_id': 'req-ca020382-0d5b-49af-be77-1f6b31c91067'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.488912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5f821b12be497a9dd7cf0f31d42fcc', 'request_id': 'req-ca020382-0d5b-49af-be77-1f6b31c91067'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.494473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5f821b12be497a9dd7cf0f31d42fcc', 'request_id': 'req-ca020382-0d5b-49af-be77-1f6b31c91067'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.505408 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] The token cache is being invalidate because project 5d5f821b12be497a9dd7cf0f31d42fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:44.505694 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.506330 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.507887 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1349/2682] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:44 2022] DELETE /identity/v3/projects/5d5f821b12be497a9dd7cf0f31d42fcc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:44.512069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:44.522030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2d810-2d9d-4977-89de-63c33033e94b service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:44.583488 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:44.584142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:44.584424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:44.584700 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] PATH_INFO: `/v3/users/e769ed9aef834ac8b731d5a5c3a5fbdd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:44.585950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e769ed9aef834ac8b731d5a5c3a5fbdd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:44.587874 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:44.636768 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e769ed9aef834ac8b731d5a5c3a5fbdd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.644618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e769ed9aef834ac8b731d5a5c3a5fbdd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.655591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:44.657063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e769ed9aef834ac8b731d5a5c3a5fbdd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.666132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e769ed9aef834ac8b731d5a5c3a5fbdd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.666828 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f9291520-c15f-4946-8138-927f34833a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e769ed9aef834ac8b731d5a5c3a5fbdd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:44.672679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1334/2683] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:43:44 2022] DELETE /identity/v3/users/e769ed9aef834ac8b731d5a5c3a5fbdd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:44.944011 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:44.945816 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:44.960513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca020382-0d5b-49af-be77-1f6b31c91067 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:44.993516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:45.019575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.020222 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.020510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.020779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] PATH_INFO: `/v3/projects/88eaf32ea99d431684235a5edef4a654` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.021988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88eaf32ea99d431684235a5edef4a654)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.023951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.070967 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88eaf32ea99d431684235a5edef4a654', 'request_id': 'req-d128e9e0-cf87-4c7e-b762-61c800667392'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:45.079039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88eaf32ea99d431684235a5edef4a654', 'request_id': 'req-d128e9e0-cf87-4c7e-b762-61c800667392'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:45.087002 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88eaf32ea99d431684235a5edef4a654', 'request_id': 'req-d128e9e0-cf87-4c7e-b762-61c800667392'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:45.100938 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] The token cache is being invalidate because project 88eaf32ea99d431684235a5edef4a654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:43:45.101229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:45.101937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d128e9e0-cf87-4c7e-b762-61c800667392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:43:45.103518 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1350/2684] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:43:44 2022] DELETE /identity/v3/projects/88eaf32ea99d431684235a5edef4a654 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:45.109703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4fa60-3f5e-4fd7-b01e-f3e41fcbe789 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.110203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4fa60-3f5e-4fd7-b01e-f3e41fcbe789 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.110320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4fa60-3f5e-4fd7-b01e-f3e41fcbe789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.133184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-40b4fa60-3f5e-4fd7-b01e-f3e41fcbe789 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:45.134470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-40b4fa60-3f5e-4fd7-b01e-f3e41fcbe789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:45.202646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1335/2685] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:45.210945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5875e8-4099-4f6e-8257-283321bcae74 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.211240 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5875e8-4099-4f6e-8257-283321bcae74 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.211521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5875e8-4099-4f6e-8257-283321bcae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.232489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7f5875e8-4099-4f6e-8257-283321bcae74 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:45.233740 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7f5875e8-4099-4f6e-8257-283321bcae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:45.243267 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1351/2686] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:45.247861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4fa60-3f5e-4fd7-b01e-f3e41fcbe789 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:45.258124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4fa60-3f5e-4fd7-b01e-f3e41fcbe789 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:45.263186 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.263796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.264073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.264354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.265044 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:43:45.265368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.266947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.278655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1336/2687] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:43:45.283387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5875e8-4099-4f6e-8257-283321bcae74 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:45.293037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5875e8-4099-4f6e-8257-283321bcae74 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:45.298178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.298784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.299061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.299329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.299979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.301926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.330735 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1352/2688] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:43:45 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:43:45.334952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:45.345466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389239b-621d-485d-9880-e70f93fbd52c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:45.407800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.408430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.408713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.409019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.409748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.411667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.434364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1337/2689] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:43:45 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:43:45.438749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:45.449264 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eb992-693a-4204-90ff-561e870061e7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:45.455053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.455670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.455963 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.456243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.457010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.458657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.472879 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1353/2690] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:45.476896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:45.490912 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c41d0-b976-4a14-8c4c-dc244806c3b6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:45.499394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3934-fad8-41de-a145-9397f4947c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.500207 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3934-fad8-41de-a145-9397f4947c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.500576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3934-fad8-41de-a145-9397f4947c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.500867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3934-fad8-41de-a145-9397f4947c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.501934 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3934-fad8-41de-a145-9397f4947c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.504067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3934-fad8-41de-a145-9397f4947c4c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.517343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1338/2691] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:43:45.522329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:45.538383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2395a8-e4db-4169-9479-1d448c9ed12a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:45.545157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.545936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.546221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.546493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] PATH_INFO: `/v3/projects/86bafde9b2f045158cdb90638056769b/users/c92d8dcc34a24e69b0b30fb9cb1bfdbd/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.561532 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bafde9b2f045158cdb90638056769b, user_id=c92d8dcc34a24e69b0b30fb9cb1bfdbd, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.564230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.579091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1354/2692] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:43:45 2022] PUT /identity/v3/projects/86bafde9b2f045158cdb90638056769b/users/c92d8dcc34a24e69b0b30fb9cb1bfdbd/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:43:45.590841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.591109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.591388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.621071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] MFA Rules not processed for user `c92d8dcc34a24e69b0b30fb9cb1bfdbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:43:45.622341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:45.670204 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:45.696826 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1339/2693] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:43:45.709034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:43:45.710985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:43:45.789403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:45.804049 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f16cf-9d14-4978-9ca9-2e0079b1c279 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:43:45.810614 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33756ac3-6958-461e-93e0-1c40184138db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:43:45.811279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756ac3-6958-461e-93e0-1c40184138db service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:43:45.811593 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756ac3-6958-461e-93e0-1c40184138db service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:43:45.811874 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756ac3-6958-461e-93e0-1c40184138db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:43:45.821506 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33756ac3-6958-461e-93e0-1c40184138db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:43:45.823108 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33756ac3-6958-461e-93e0-1c40184138db service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:43:45.832801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1355/2694] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:43:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:43:55.693584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=8 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:55.828345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:10.340423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:10.342026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:10.427881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a4d1-bc71-443b-aa0a-64377ccb3ce4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:10.434406 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:10.435430 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:10.435796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:10.436171 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:10.450206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:10.478512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:10.480346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:10.494603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1340/2695] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:44:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:44:16.478536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:16.479099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:16.479099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:16.498509 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] MFA Rules not processed for user `47b7581896ed45a8987b70f3c80214b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:44:16.499707 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:16.554009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1356/2696] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:44:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:44:17.117612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:17.119102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:17.177328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6704-855b-4dbb-8181-1898bffd5aee service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:17.181306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:17.181965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:17.182241 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:17.182514 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:17.184364 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:17.194429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:17.195843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:17.204800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1341/2697] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:44:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:44:17.548897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:17.550682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:17.626752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad1c5f-27a3-4b7c-8352-528c6212f340 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:17.632288 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ef5d5-e98c-48a0-abda-2ff2d43eb9bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:17.632933 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef5d5-e98c-48a0-abda-2ff2d43eb9bb service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:17.633220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef5d5-e98c-48a0-abda-2ff2d43eb9bb service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:17.633514 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef5d5-e98c-48a0-abda-2ff2d43eb9bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:17.635628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-702ef5d5-e98c-48a0-abda-2ff2d43eb9bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:17.648659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ef5d5-e98c-48a0-abda-2ff2d43eb9bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:17.650326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ef5d5-e98c-48a0-abda-2ff2d43eb9bb service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:17.661922 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1357/2698] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:44:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:44:20.175630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:20.254655 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf057b8-d669-4798-9c24-25586eb9feb0 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:20.259692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:20.260763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:20.261145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:20.261551 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] PATH_INFO: `/v3/users/c92d8dcc34a24e69b0b30fb9cb1bfdbd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:20.263145 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92d8dcc34a24e69b0b30fb9cb1bfdbd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:20.265346 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:20.305659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:20.321185 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92d8dcc34a24e69b0b30fb9cb1bfdbd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.332475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92d8dcc34a24e69b0b30fb9cb1bfdbd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.345429 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92d8dcc34a24e69b0b30fb9cb1bfdbd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.352965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92d8dcc34a24e69b0b30fb9cb1bfdbd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.353754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92d8dcc34a24e69b0b30fb9cb1bfdbd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.360062 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1342/2699] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:44:20 2022] DELETE /identity/v3/users/c92d8dcc34a24e69b0b30fb9cb1bfdbd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:44:20.364693 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:20.365174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:20.365304 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:20.384788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:44:20.386043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:20.445324 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1358/2700] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:44:20.455915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:20.457373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:20.518510 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6015c-fb3f-46a5-be64-5b6ec28366c1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:20.523641 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14fc4-27a5-4271-96ee-66f5484ff6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:20.524293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14fc4-27a5-4271-96ee-66f5484ff6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:20.524582 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14fc4-27a5-4271-96ee-66f5484ff6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:20.524862 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14fc4-27a5-4271-96ee-66f5484ff6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:20.534559 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14fc4-27a5-4271-96ee-66f5484ff6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:20.536089 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14fc4-27a5-4271-96ee-66f5484ff6d6 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:20.547019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1343/2701] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:44:20.827520 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:20.829022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:20.841808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9dae6-0d58-4bd3-844b-aaee71ca51a1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:20.847054 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:20.847903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:20.848311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:20.848585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] PATH_INFO: `/v3/projects/86bafde9b2f045158cdb90638056769b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:20.849819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bafde9b2f045158cdb90638056769b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:20.851739 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:20.887014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:20.899980 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bafde9b2f045158cdb90638056769b', 'request_id': 'req-84c5f8b8-e568-4787-81cf-2f25e935856a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.908998 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bafde9b2f045158cdb90638056769b', 'request_id': 'req-84c5f8b8-e568-4787-81cf-2f25e935856a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.914553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bafde9b2f045158cdb90638056769b', 'request_id': 'req-84c5f8b8-e568-4787-81cf-2f25e935856a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.925572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] The token cache is being invalidate because project 86bafde9b2f045158cdb90638056769b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:44:20.925866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.926512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-84c5f8b8-e568-4787-81cf-2f25e935856a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:44:20.928058 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1359/2702] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:44:20 2022] DELETE /identity/v3/projects/86bafde9b2f045158cdb90638056769b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:44:20.933097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a92a-b794-4b0a-9c23-86e90c76cd0e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:20.933433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a92a-b794-4b0a-9c23-86e90c76cd0e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:20.933713 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a92a-b794-4b0a-9c23-86e90c76cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:20.954248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2811a92a-b794-4b0a-9c23-86e90c76cd0e None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:44:20.955447 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2811a92a-b794-4b0a-9c23-86e90c76cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:21.017766 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1344/2703] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:44:21.026138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d66b9-6cc4-44ad-a66a-c6afffd47d96 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.026457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d66b9-6cc4-44ad-a66a-c6afffd47d96 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.026736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d66b9-6cc4-44ad-a66a-c6afffd47d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.047041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f24d66b9-6cc4-44ad-a66a-c6afffd47d96 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:44:21.048228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f24d66b9-6cc4-44ad-a66a-c6afffd47d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:21.056291 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1360/2704] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:44:21.061196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a92a-b794-4b0a-9c23-86e90c76cd0e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:21.077126 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a92a-b794-4b0a-9c23-86e90c76cd0e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:21.084015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:21.084628 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.084909 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.085183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.085931 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:44:21.086236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:21.087830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:21.099811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1345/2705] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:44:21.104247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d66b9-6cc4-44ad-a66a-c6afffd47d96 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:21.114102 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d66b9-6cc4-44ad-a66a-c6afffd47d96 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:21.119988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:21.120634 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.120912 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.121180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.121870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:21.123764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:21.154605 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1361/2706] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:44:21 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:44:21.159055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:21.169971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6c40-cf2c-4a35-abb7-cf0eb58c108e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:21.204817 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:21.230498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:21.231121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.231413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.231688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.232362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:21.234330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:21.257660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1346/2707] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:44:21 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:44:21.262036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:21.272717 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09833-d553-4139-8076-86c1ce80792b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:21.277880 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:21.278500 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.278793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.279059 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.279763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:21.281453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:21.293220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1362/2708] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:44:21.297184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:21.308064 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a64ed-67f7-4141-8db4-a05958fffdc7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:21.313964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc871278-2352-4647-bdbd-fb7cae8823a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:21.314688 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871278-2352-4647-bdbd-fb7cae8823a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.315033 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871278-2352-4647-bdbd-fb7cae8823a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.315380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871278-2352-4647-bdbd-fb7cae8823a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.316082 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc871278-2352-4647-bdbd-fb7cae8823a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:21.317699 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc871278-2352-4647-bdbd-fb7cae8823a3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:21.328784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1347/2709] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:44:21.333399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:21.343863 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de256a-4b58-4d74-bc83-60ec05b88657 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:21.349310 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:21.350013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.350260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.350569 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] PATH_INFO: `/v3/projects/50de78c8a54c469fa2f25b5abec29a05/users/7c86db6d9a99465f8bb902b8e4afbc43/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.365845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50de78c8a54c469fa2f25b5abec29a05, user_id=7c86db6d9a99465f8bb902b8e4afbc43, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:21.368534 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:21.384410 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1363/2710] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:44:21 2022] PUT /identity/v3/projects/50de78c8a54c469fa2f25b5abec29a05/users/7c86db6d9a99465f8bb902b8e4afbc43/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:44:21.389807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466716c-55fb-4aea-ac84-9b8d19e5602b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.390180 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466716c-55fb-4aea-ac84-9b8d19e5602b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.390547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466716c-55fb-4aea-ac84-9b8d19e5602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.410099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6466716c-55fb-4aea-ac84-9b8d19e5602b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:44:21.411333 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6466716c-55fb-4aea-ac84-9b8d19e5602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:21.471651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1348/2711] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:44:21.483299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:21.485012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:21.541513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61f597-82a9-4dac-bb67-8d52c93d01c0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:21.545116 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:21.545837 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:21.546109 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:21.546380 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:21.555562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:21.556990 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:21.566515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1364/2712] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:44:22.190043 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c61a9e-3acd-4eba-8246-87e169d2e36d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:22.190336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c61a9e-3acd-4eba-8246-87e169d2e36d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:22.190753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c61a9e-3acd-4eba-8246-87e169d2e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:22.223416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-90c61a9e-3acd-4eba-8246-87e169d2e36d None None] MFA Rules not processed for user `7c86db6d9a99465f8bb902b8e4afbc43`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:44:22.224684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-90c61a9e-3acd-4eba-8246-87e169d2e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:22.301668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1349/2713] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:44:22.313113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:22.314574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:22.376089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2002e-7a17-48bb-bb89-1e875ce819f8 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:22.379954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:22.380592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:22.380866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:22.381136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:22.390540 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:22.392000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:22.397821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:22.405155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1365/2714] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:44:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:44:23.803704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa71f3-78f7-4313-8560-337f9c07e408 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:23.804266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa71f3-78f7-4313-8560-337f9c07e408 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:23.804266 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa71f3-78f7-4313-8560-337f9c07e408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:23.823755 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-25fa71f3-78f7-4313-8560-337f9c07e408 None None] MFA Rules not processed for user `7c86db6d9a99465f8bb902b8e4afbc43`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:44:23.824996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25fa71f3-78f7-4313-8560-337f9c07e408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:23.832991 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1350/2715] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:44:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:44:26.935557 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:44:26.937839 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:27.026150 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173e6d9-0160-4693-88b5-a559d5cd7222 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:44:27.031620 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:44:27.032286 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:44:27.032566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:44:27.032843 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:44:27.035652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:44:27.051182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:44:27.053027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:44:27.063856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1366/2716] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:44:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:44:33.818103 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:37.059283 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=34 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:26.971494 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4118b3-8ae1-4f75-b449-a74661e28d6b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:45:26.972025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4118b3-8ae1-4f75-b449-a74661e28d6b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:45:26.972025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4118b3-8ae1-4f75-b449-a74661e28d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:45:26.991602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6a4118b3-8ae1-4f75-b449-a74661e28d6b None None] MFA Rules not processed for user `8ed5256562974246b15e474439811df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:45:26.992811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6a4118b3-8ae1-4f75-b449-a74661e28d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:45:27.051162 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1351/2717] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:45:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:45:27.380788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:45:27.382311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:45:27.394807 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f926fc-5487-432f-87a8-0428d9bd78bb service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:45:27.399671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:45:27.400297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:45:27.400596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:45:27.400870 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:45:27.402895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:45:27.412643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:45:27.414136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:45:27.422201 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1367/2718] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:45:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:45:37.043398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=25 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:37.418988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:42.485865 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbfbb8-bf94-4cce-99ed-029401528786 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:45:42.486377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbfbb8-bf94-4cce-99ed-029401528786 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:45:42.486377 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbfbb8-bf94-4cce-99ed-029401528786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:45:42.512630 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-37bbfbb8-bf94-4cce-99ed-029401528786 None None] MFA Rules not processed for user `7c86db6d9a99465f8bb902b8e4afbc43`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:45:42.513872 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-37bbfbb8-bf94-4cce-99ed-029401528786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:45:42.521838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1352/2719] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:45:52.505571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:22.445985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:46:22.447920 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:46:22.525903 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4edf6-1e26-492d-8713-5f5390a28600 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:46:22.531351 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:46:22.531977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:46:22.532254 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:46:22.532527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:46:22.534424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:46:22.546595 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:46:22.548195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:46:22.558238 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1368/2720] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:46:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:46:27.479097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbfbb8-bf94-4cce-99ed-029401528786 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:46:27.493635 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbfbb8-bf94-4cce-99ed-029401528786 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:46:27.500390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:46:27.501005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:46:27.501315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:46:27.501595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:46:27.503508 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:46:27.563148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:46:27.564738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:46:27.574114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1353/2721] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:46:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:46:32.554024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=32 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:37.570075 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=28 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:49.370826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:46:49.381891 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b36b23-5e7c-4fc3-8d8c-833f70317205 service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:46:49.388750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:46:49.389403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:46:49.389729 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:46:49.389989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:46:49.392658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:46:49.405132 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:46:49.406840 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:46:49.419121 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1369/2722] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:46:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:46:49.429496 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:46:49.442972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d80358-5cdc-4f95-883c-201be911c2bb service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:46:49.448308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:46:49.448971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:46:49.449306 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:46:49.449601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] PATH_INFO: `/v3/users/7c86db6d9a99465f8bb902b8e4afbc43` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:46:49.450725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c86db6d9a99465f8bb902b8e4afbc43)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:46:49.453003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:46:49.510149 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c86db6d9a99465f8bb902b8e4afbc43'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.518878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c86db6d9a99465f8bb902b8e4afbc43'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.531388 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c86db6d9a99465f8bb902b8e4afbc43'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.538695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c86db6d9a99465f8bb902b8e4afbc43'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.539438 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bce6d53c-cd8d-4525-b45e-0f299cbbd542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c86db6d9a99465f8bb902b8e4afbc43'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.545951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1354/2723] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:46:49 2022] DELETE /identity/v3/users/7c86db6d9a99465f8bb902b8e4afbc43 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:46:49.729127 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:46:49.743794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b071-d446-428a-901e-c8a507ec77d3 service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:46:49.807184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:46:49.807833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:46:49.808110 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:46:49.808382 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] PATH_INFO: `/v3/projects/50de78c8a54c469fa2f25b5abec29a05` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:46:49.809567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50de78c8a54c469fa2f25b5abec29a05)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:46:49.811487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:46:49.859701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50de78c8a54c469fa2f25b5abec29a05', 'request_id': 'req-0576231d-1f58-4307-bab3-5f95ee398b5c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.867296 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50de78c8a54c469fa2f25b5abec29a05', 'request_id': 'req-0576231d-1f58-4307-bab3-5f95ee398b5c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.873046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50de78c8a54c469fa2f25b5abec29a05', 'request_id': 'req-0576231d-1f58-4307-bab3-5f95ee398b5c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.884280 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] The token cache is being invalidate because project 50de78c8a54c469fa2f25b5abec29a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:46:49.884566 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.885207 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:46:49.886745 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1370/2724] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:46:49 2022] DELETE /identity/v3/projects/50de78c8a54c469fa2f25b5abec29a05 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:46:52.610801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:46:52.611283 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:46:52.611412 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:46:52.631261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:46:52.632471 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:46:52.689016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1355/2725] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:46:52.739897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:46:52.742035 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:46:52.822298 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576231d-1f58-4307-bab3-5f95ee398b5c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:46:52.828581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:46:52.829208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:46:52.829519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:46:52.829793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:46:52.838168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:46:52.839772 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:46:52.848199 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1371/2726] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:47:02.681996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:02.844857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:06.386603 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:47:06.388131 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:06.450683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd021f4-238f-4ef2-bc3b-d7f1b62fe5e1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:47:06.455456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb625a81268d4067a59dbd34de4019cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:47:06.456253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:06.456661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:06.456985 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:06.459754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:06.532960 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:47:06.534482 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:47:06.545707 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1356/2727] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:47:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:47:06.615284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:47:06.616715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:06.674037 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391216-fdf3-49d7-9633-78ce4f1f4a10 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:47:06.677670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ef91-cb12-4e14-9b81-57faaa138832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:47:06.678278 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ef91-cb12-4e14-9b81-57faaa138832 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:06.678555 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ef91-cb12-4e14-9b81-57faaa138832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:06.678826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ef91-cb12-4e14-9b81-57faaa138832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:06.680686 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bc63ef91-cb12-4e14-9b81-57faaa138832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:06.690282 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ef91-cb12-4e14-9b81-57faaa138832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:47:06.691799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ef91-cb12-4e14-9b81-57faaa138832 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:47:06.699731 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1372/2728] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:47:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:47:06.782681 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:47:06.793079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736ae3-d5ba-4fcd-8593-9c6c353415e3 service glance] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:47:06.797779 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:47:06.798528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:06.799097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:06.799543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:06.802293 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:06.819436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:47:06.820891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:47:06.835776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1357/2729] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:47:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:47:08.496032 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68141c-9174-481b-bedf-2dea5f806bbd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:08.496559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68141c-9174-481b-bedf-2dea5f806bbd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:08.496691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68141c-9174-481b-bedf-2dea5f806bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:08.516334 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1c68141c-9174-481b-bedf-2dea5f806bbd None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:47:08.517571 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1c68141c-9174-481b-bedf-2dea5f806bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:08.525415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1373/2730] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Jul 29 08:47:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:47:08.537726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:47:08.550069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ff73-fc50-4a34-bbf4-4c051b40b154 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:47:08.557636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:47:08.558267 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:08.558548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:08.558823 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:08.567591 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:47:08.569165 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:47:08.577236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1358/2731] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:47:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:47:18.511178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=29 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:18.574069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=66 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:27.298217 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:27.298730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:27.298730 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:27.319808 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] MFA Rules not processed for user `e7576c5e6d64401bba9e8d23ca0c638b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:47:27.321009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:27.329565 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1374/2732] 10.222.0.47 () {58 vars in 967 bytes} [Fri Jul 29 08:47:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:47:27.342410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:47:27.353423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c8edd-c111-4052-892e-d30c221854ce service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:47:27.358993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58562c0-ff4d-4a2b-8011-d649a4cf757c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ed5e24f863460ab8dea052bed1dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:47:27.359612 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58562c0-ff4d-4a2b-8011-d649a4cf757c service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:27.359896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58562c0-ff4d-4a2b-8011-d649a4cf757c service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:27.360170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58562c0-ff4d-4a2b-8011-d649a4cf757c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:27.368536 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58562c0-ff4d-4a2b-8011-d649a4cf757c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:47:27.370210 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58562c0-ff4d-4a2b-8011-d649a4cf757c service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:47:27.378134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1359/2733] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Jul 29 08:47:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 08:47:37.314142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:37.375019 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:59.226798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:47:59.228594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:59.293966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0d2b0-c788-4360-a895-0d20992d7d48 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:47:59.298387 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:47:59.299009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:47:59.299286 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:47:59.299560 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:47:59.301901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:47:59.363750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:47:59.365226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:47:59.374873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1375/2734] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:47:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:09.370377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=48 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:10.482016 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:10.482567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:10.482567 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:10.503873 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] MFA Rules not processed for user `8ed5256562974246b15e474439811df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:10.505018 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:10.513143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1360/2735] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:10.551581 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:10.560501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e54475-1b4a-44fd-bf5a-7a9f9dc8053e service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:10.564516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:10.565134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:10.565440 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:10.565817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:10.567689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:10.581592 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:10.583022 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:10.594345 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1376/2736] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:11.359964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:11.362487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:11.374763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be38e-e721-4e52-aad3-5d34566e2cdb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:11.378583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:11.379205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:11.379490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:11.379785 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:11.381583 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:11.396194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:11.397706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:11.409067 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1361/2737] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:13.170372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:13.181261 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561adf-6437-4cfc-85c2-5a80c6272c82 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:13.185559 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:13.186604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:13.186949 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:13.187284 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:13.189188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:13.200787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:13.202723 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:13.214098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1377/2738] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:21.404446 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=9 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:23.209857 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=12 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:29.426246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:29.435232 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f02af-a9a7-49c2-b1ad-6b235662ca37 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:29.439238 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:29.439850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:29.440129 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:29.440398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:29.442297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:29.522594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:29.524734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:29.538010 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1362/2739] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:39.532124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=30 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:39.942785 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:39.951911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a6000-28d6-408f-99d6-3b233a711649 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:39.956226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:39.956836 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:39.957112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:39.957421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:39.959331 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:40.026175 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:40.027650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:40.038777 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1378/2740] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:48:43.455036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:43.456636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:43.471403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f531dc-d5cc-485e-866e-fce2f51e1f36 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:43.476170 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:43.476830 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:43.477116 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:43.477434 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] PATH_INFO: `/v3/users/47b7581896ed45a8987b70f3c80214b2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:43.478599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b7581896ed45a8987b70f3c80214b2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:43.480546 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:43.532529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b7581896ed45a8987b70f3c80214b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.540643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b7581896ed45a8987b70f3c80214b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.552588 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b7581896ed45a8987b70f3c80214b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.559617 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b7581896ed45a8987b70f3c80214b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.560370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9112aec-a52d-4709-90f7-154259a095df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b7581896ed45a8987b70f3c80214b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.566887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1363/2741] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:48:43 2022] DELETE /identity/v3/users/47b7581896ed45a8987b70f3c80214b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:43.751489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:43.763168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9feff-3efe-467c-9ddc-e6e6ae5dee10 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:43.819803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:43.820451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:43.820727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:43.821001 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] PATH_INFO: `/v3/projects/0c161e438fee4a29b0f89ab266117e6c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:43.822219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c161e438fee4a29b0f89ab266117e6c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:43.824118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:43.882481 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c161e438fee4a29b0f89ab266117e6c', 'request_id': 'req-9bfd0963-58ed-4251-b7d2-66e209976023'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.894873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c161e438fee4a29b0f89ab266117e6c', 'request_id': 'req-9bfd0963-58ed-4251-b7d2-66e209976023'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.900917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c161e438fee4a29b0f89ab266117e6c', 'request_id': 'req-9bfd0963-58ed-4251-b7d2-66e209976023'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.913454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] The token cache is being invalidate because project 0c161e438fee4a29b0f89ab266117e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:48:43.913752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.914443 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9bfd0963-58ed-4251-b7d2-66e209976023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:43.916027 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1379/2742] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:48:43 2022] DELETE /identity/v3/projects/0c161e438fee4a29b0f89ab266117e6c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:43.921109 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fd68-ff91-401d-a1a4-743f30c7ed26 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:43.921387 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fd68-ff91-401d-a1a4-743f30c7ed26 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:43.921657 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fd68-ff91-401d-a1a4-743f30c7ed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:43.941435 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5fa2fd68-ff91-401d-a1a4-743f30c7ed26 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:43.942637 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5fa2fd68-ff91-401d-a1a4-743f30c7ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:44.008055 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1364/2743] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:48:44.015956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee120bf9-e7d5-4ac5-b3d9-e8fc4493e931 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.016268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee120bf9-e7d5-4ac5-b3d9-e8fc4493e931 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.016541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee120bf9-e7d5-4ac5-b3d9-e8fc4493e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.036475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ee120bf9-e7d5-4ac5-b3d9-e8fc4493e931 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:44.037703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ee120bf9-e7d5-4ac5-b3d9-e8fc4493e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:44.045977 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1380/2744] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:44.051071 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fd68-ff91-401d-a1a4-743f30c7ed26 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.069719 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fd68-ff91-401d-a1a4-743f30c7ed26 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.079380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.080271 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.080677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.081072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.081913 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:48:44.082222 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.083860 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.096179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1365/2745] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 08:48:44.101434 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee120bf9-e7d5-4ac5-b3d9-e8fc4493e931 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.115688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee120bf9-e7d5-4ac5-b3d9-e8fc4493e931 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.124934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.125902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.126245 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.126487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.127395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.129744 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.146435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:44.164456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1381/2746] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:48:44 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:48:44.168718 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.178861 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2d2eb-ceca-46ed-bef9-19c272d29935 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.239035 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.239696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.239958 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.240245 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.240916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.242889 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.251095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:44.267693 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1366/2747] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:48:44 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:48:44.271937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.282125 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1654a-65b0-4991-b573-987afea3674e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.286791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.287390 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.287667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.287937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.288643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.290272 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.300736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1382/2748] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:48:44.304585 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.314911 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcd218-bceb-4526-a979-dc6cb905ac51 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.320108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ad3e-28da-472c-be20-95eb811731dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.320732 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ad3e-28da-472c-be20-95eb811731dc admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.321014 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ad3e-28da-472c-be20-95eb811731dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.321314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ad3e-28da-472c-be20-95eb811731dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.322142 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ad3e-28da-472c-be20-95eb811731dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.323745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ad3e-28da-472c-be20-95eb811731dc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.335177 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1367/2749] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:48:44.339422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.350185 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0757-ae10-4488-b530-2c16cf03ab96 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.356105 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.356762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.357043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.357305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] PATH_INFO: `/v3/projects/1b90b50c3cc34ab48e8056d9b9073dac/users/d185a5d9107743a1a1f74336db756a3f/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.374765 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b90b50c3cc34ab48e8056d9b9073dac, user_id=d185a5d9107743a1a1f74336db756a3f, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.377487 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.392979 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1383/2750] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:48:44 2022] PUT /identity/v3/projects/1b90b50c3cc34ab48e8056d9b9073dac/users/d185a5d9107743a1a1f74336db756a3f/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:44.403576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbcfc-4b09-4fad-ac1e-6c14efcc001d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.403863 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbcfc-4b09-4fad-ac1e-6c14efcc001d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.404138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbcfc-4b09-4fad-ac1e-6c14efcc001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.432981 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-039cbcfc-4b09-4fad-ac1e-6c14efcc001d None None] MFA Rules not processed for user `d185a5d9107743a1a1f74336db756a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:44.434166 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-039cbcfc-4b09-4fad-ac1e-6c14efcc001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:44.504772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1368/2751] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:44.509630 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.573381 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6b7b-2e61-4f7a-9d13-67b274f3fd84 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.578826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.579444 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.579689 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.579986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.580664 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.582646 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.614010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1384/2752] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:48:44 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:48:44.615049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cbcfc-4b09-4fad-ac1e-6c14efcc001d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.626757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cbcfc-4b09-4fad-ac1e-6c14efcc001d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.689127 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.689789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.690072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.690498 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.691028 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.693114 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.717425 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1369/2753] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:48:44 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:48:44.721433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.732182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe411a4-ab20-4402-ad6e-9441c1765a1e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.736888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.737671 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.737954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.738229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.738935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.740547 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.751076 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1385/2754] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:48:44.755275 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.765511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7aec-3415-4b49-a626-f7fea95ad76a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.770188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.770853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.771134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.771411 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] PATH_INFO: `/v3/projects/82213f695ab745e5b70308f6294661c5/users/392485a57624415a85fa7723bd3a66d6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.785892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82213f695ab745e5b70308f6294661c5, user_id=392485a57624415a85fa7723bd3a66d6, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.788539 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.807441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1370/2755] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:48:44 2022] PUT /identity/v3/projects/82213f695ab745e5b70308f6294661c5/users/392485a57624415a85fa7723bd3a66d6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:44.812817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.827668 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7656a-e708-4f5e-981b-7b46ed7934e6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.891165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527baef-3ceb-4397-bc94-8f1ed9c6ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.891788 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527baef-3ceb-4397-bc94-8f1ed9c6ebb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.892071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527baef-3ceb-4397-bc94-8f1ed9c6ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.892346 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527baef-3ceb-4397-bc94-8f1ed9c6ebb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.893040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527baef-3ceb-4397-bc94-8f1ed9c6ebb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.894691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527baef-3ceb-4397-bc94-8f1ed9c6ebb5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.904279 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1386/2756] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:48:44.908597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:44.919568 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fccecc-bae7-430c-a680-087c5edbd233 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:44.924544 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:44.925205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:44.925524 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:44.925803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] PATH_INFO: `/v3/projects/82213f695ab745e5b70308f6294661c5/users/392485a57624415a85fa7723bd3a66d6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:44.927914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=82213f695ab745e5b70308f6294661c5, user_id=392485a57624415a85fa7723bd3a66d6, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:44.930605 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:44.942600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1371/2757] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:48:44 2022] PUT /identity/v3/projects/82213f695ab745e5b70308f6294661c5/users/392485a57624415a85fa7723bd3a66d6/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:45.009773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7036a0-2855-4ca7-b6d5-e575014961b8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:45.010024 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7036a0-2855-4ca7-b6d5-e575014961b8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:45.010430 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7036a0-2855-4ca7-b6d5-e575014961b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:45.048915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ba7036a0-2855-4ca7-b6d5-e575014961b8 None None] MFA Rules not processed for user `392485a57624415a85fa7723bd3a66d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:45.050152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ba7036a0-2855-4ca7-b6d5-e575014961b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:45.069888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:45.122579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1387/2758] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:45.134423 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:45.136552 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:45.162226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:45.200615 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8dfb3-c2a6-431d-8c89-8c46475423ff admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:45.205123 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:45.205769 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:45.206048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:45.206324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:45.215843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:45.217305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:45.227937 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1372/2759] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:45.306950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7036a0-2855-4ca7-b6d5-e575014961b8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:45.317166 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7036a0-2855-4ca7-b6d5-e575014961b8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:45.321084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790f52-075b-4cb9-96cd-3f1e02224104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:45.321737 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790f52-075b-4cb9-96cd-3f1e02224104 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:45.322014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790f52-075b-4cb9-96cd-3f1e02224104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:45.322287 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790f52-075b-4cb9-96cd-3f1e02224104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:45.380178 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b790f52-075b-4cb9-96cd-3f1e02224104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:45.382520 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b790f52-075b-4cb9-96cd-3f1e02224104 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:45.395721 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1388/2760] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:55.222896 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=17 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:55.389684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=48 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:56.851906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:56.917040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca747e-0dcf-4967-8ba4-4009706515dd service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:56.921996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:56.922631 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:56.922908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:56.923208 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] PATH_INFO: `/v3/users/d185a5d9107743a1a1f74336db756a3f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:56.924400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d185a5d9107743a1a1f74336db756a3f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:56.926357 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:56.982979 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd185a5d9107743a1a1f74336db756a3f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:56.992752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd185a5d9107743a1a1f74336db756a3f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.005088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd185a5d9107743a1a1f74336db756a3f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.012106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd185a5d9107743a1a1f74336db756a3f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.012789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd185a5d9107743a1a1f74336db756a3f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.018807 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1373/2761] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:48:56 2022] DELETE /identity/v3/users/d185a5d9107743a1a1f74336db756a3f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:57.023397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:57.023880 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:57.023995 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:57.042988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:57.044183 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:57.103533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1389/2762] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:57.113495 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:57.115038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:57.174260 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a9b2-622c-47ae-9a94-d0f7c3f12fac admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:57.178458 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:57.179102 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:57.179386 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:57.179661 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:57.189479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:57.190950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:57.201152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1374/2763] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:48:57.473141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:57.474748 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:57.491770 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf4205-611f-4f47-9588-d9d1da778f24 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:57.497477 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:57.498164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:57.498442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:57.498715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] PATH_INFO: `/v3/projects/1b90b50c3cc34ab48e8056d9b9073dac` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:57.499897 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b90b50c3cc34ab48e8056d9b9073dac)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:57.501921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:57.549053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b90b50c3cc34ab48e8056d9b9073dac', 'request_id': 'req-525b29cd-4727-4b11-8bf3-efd29870806f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.557378 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b90b50c3cc34ab48e8056d9b9073dac', 'request_id': 'req-525b29cd-4727-4b11-8bf3-efd29870806f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.562950 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b90b50c3cc34ab48e8056d9b9073dac', 'request_id': 'req-525b29cd-4727-4b11-8bf3-efd29870806f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.574470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] The token cache is being invalidate because project 1b90b50c3cc34ab48e8056d9b9073dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:48:57.574763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.575511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.577136 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1390/2764] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:48:57 2022] DELETE /identity/v3/projects/1b90b50c3cc34ab48e8056d9b9073dac => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:57.581754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:57.591599 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648addd8-d3ce-4eeb-83ee-174caee02919 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:57.609746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:57.650374 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:57.651022 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:57.651307 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:57.651584 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] PATH_INFO: `/v3/users/392485a57624415a85fa7723bd3a66d6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:57.652816 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392485a57624415a85fa7723bd3a66d6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:57.654796 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:57.708226 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392485a57624415a85fa7723bd3a66d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.719660 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392485a57624415a85fa7723bd3a66d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.735292 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392485a57624415a85fa7723bd3a66d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.742854 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392485a57624415a85fa7723bd3a66d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.743581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e4740024-2e84-47b8-bad5-c032dc0ecf40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392485a57624415a85fa7723bd3a66d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:57.749736 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1375/2765] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:48:57 2022] DELETE /identity/v3/users/392485a57624415a85fa7723bd3a66d6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:58.029959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.031651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:58.047585 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b29cd-4727-4b11-8bf3-efd29870806f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.107944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.108590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.108873 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.109143 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] PATH_INFO: `/v3/projects/82213f695ab745e5b70308f6294661c5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.110363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82213f695ab745e5b70308f6294661c5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.112393 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.145363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:58.163522 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82213f695ab745e5b70308f6294661c5', 'request_id': 'req-5f49a4a3-e67f-462b-8c7b-af99d82db028'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:58.170822 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82213f695ab745e5b70308f6294661c5', 'request_id': 'req-5f49a4a3-e67f-462b-8c7b-af99d82db028'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:58.176466 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82213f695ab745e5b70308f6294661c5', 'request_id': 'req-5f49a4a3-e67f-462b-8c7b-af99d82db028'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:58.188131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] The token cache is being invalidate because project 82213f695ab745e5b70308f6294661c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:48:58.188422 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:58.189133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f49a4a3-e67f-462b-8c7b-af99d82db028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:48:58.190794 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1391/2766] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:48:58 2022] DELETE /identity/v3/projects/82213f695ab745e5b70308f6294661c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:58.196006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30bb10-8535-4979-9e59-ac7930d4b7e5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.196523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30bb10-8535-4979-9e59-ac7930d4b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.196647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30bb10-8535-4979-9e59-ac7930d4b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.217818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0e30bb10-8535-4979-9e59-ac7930d4b7e5 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:58.219026 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0e30bb10-8535-4979-9e59-ac7930d4b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:58.280380 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1376/2767] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:48:58.288363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246315-690d-4d57-a70e-2cbec6c651ff None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.288678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246315-690d-4d57-a70e-2cbec6c651ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.288916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246315-690d-4d57-a70e-2cbec6c651ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.310198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-28246315-690d-4d57-a70e-2cbec6c651ff None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:58.311428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-28246315-690d-4d57-a70e-2cbec6c651ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:58.321158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1392/2768] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:58.327086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30bb10-8535-4979-9e59-ac7930d4b7e5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.342545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30bb10-8535-4979-9e59-ac7930d4b7e5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.351415 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.352042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.352324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.352601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.353313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:48:58.353643 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.355253 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.367326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1377/2769] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:48:58.371648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28246315-690d-4d57-a70e-2cbec6c651ff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.381255 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28246315-690d-4d57-a70e-2cbec6c651ff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.387533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.388177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.388453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.388749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.389428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.391339 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.421628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1393/2770] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:48:58 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:48:58.426110 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.436526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff3bcc-3e93-4982-9d89-18a98a9eb577 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.463679 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:58.497765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.498394 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.498677 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.498956 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.499650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.501621 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.525191 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1378/2771] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:48:58 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:48:58.529363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.539928 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28892a9-4996-481a-b7bd-955a97cd9d8f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.544860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.545556 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.545838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.546112 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.546819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.548439 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.561043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1394/2772] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:48:58.565611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.576137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2762c-e261-420a-924a-8ab75235fdf9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.581463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c781-2a4e-40eb-a6ef-4fd56f4b0c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.582113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c781-2a4e-40eb-a6ef-4fd56f4b0c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.582443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c781-2a4e-40eb-a6ef-4fd56f4b0c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.582723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c781-2a4e-40eb-a6ef-4fd56f4b0c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.583436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c781-2a4e-40eb-a6ef-4fd56f4b0c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.585054 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c781-2a4e-40eb-a6ef-4fd56f4b0c3c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.595751 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1379/2773] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:48:58.599961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.610629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a1ee-37ee-44fa-a7e0-2ac2f4412996 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.616482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.617295 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.617580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.617856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] PATH_INFO: `/v3/projects/5664cdc009dc467d95bb1bb77708b0bf/users/63d2ede26ad3414cb41c0bb8894fd019/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.634137 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5664cdc009dc467d95bb1bb77708b0bf, user_id=63d2ede26ad3414cb41c0bb8894fd019, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.637325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.652550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1395/2774] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:48:58 2022] PUT /identity/v3/projects/5664cdc009dc467d95bb1bb77708b0bf/users/63d2ede26ad3414cb41c0bb8894fd019/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:48:58.663030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae517178-1d05-40ec-a449-25b6d187d3b5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.663370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae517178-1d05-40ec-a449-25b6d187d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.663740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae517178-1d05-40ec-a449-25b6d187d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.693737 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ae517178-1d05-40ec-a449-25b6d187d3b5 None None] MFA Rules not processed for user `63d2ede26ad3414cb41c0bb8894fd019`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:58.694966 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ae517178-1d05-40ec-a449-25b6d187d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:58.764607 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1380/2775] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:58.769198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.834363 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a4d57-840f-4e7b-9d25-e25a38607b49 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.839741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.840357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.840636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.840889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.841617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.843530 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.873073 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1396/2776] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:48:58 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:48:58.877518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae517178-1d05-40ec-a449-25b6d187d3b5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.888954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae517178-1d05-40ec-a449-25b6d187d3b5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:58.951194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:58.951977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:58.952354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:58.952636 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:58.953929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:58.956876 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:58.982648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1381/2777] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:48:58 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:48:58.986988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:58.997432 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cfd6e-d67d-43c3-bd81-98a84f32e359 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:59.002520 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:59.003153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:59.003438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:59.003710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:59.004415 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:59.006079 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:59.016771 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1397/2778] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:48:59.020870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:59.031321 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ceab2-ed42-4a06-80eb-2022d9422dce admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:59.036994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:59.037695 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:59.037977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:59.038254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] PATH_INFO: `/v3/projects/34a67023bff8489fb3b10d502d5428ec/users/ac51501c19914de3a13e8e0a20f38622/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:59.054183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a67023bff8489fb3b10d502d5428ec, user_id=ac51501c19914de3a13e8e0a20f38622, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:59.056869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:59.071724 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1382/2779] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:48:59 2022] PUT /identity/v3/projects/34a67023bff8489fb3b10d502d5428ec/users/ac51501c19914de3a13e8e0a20f38622/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:59.075650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:59.086926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f017d7-f082-4363-ae58-8e008ffaa25a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:59.107882 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:59.148889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0c86-2d34-4a2a-8784-d916e7644153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:59.149527 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0c86-2d34-4a2a-8784-d916e7644153 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:59.149804 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0c86-2d34-4a2a-8784-d916e7644153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:59.150107 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0c86-2d34-4a2a-8784-d916e7644153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:59.150791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0c86-2d34-4a2a-8784-d916e7644153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:59.152401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0c86-2d34-4a2a-8784-d916e7644153 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:59.162636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1398/2780] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:48:59.167038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:59.172831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:59.178525 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469720-4337-48e5-9a89-546dbf006b4e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:59.184777 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:59.185479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:59.185760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:59.186040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] PATH_INFO: `/v3/projects/34a67023bff8489fb3b10d502d5428ec/users/ac51501c19914de3a13e8e0a20f38622/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:59.187969 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a67023bff8489fb3b10d502d5428ec, user_id=ac51501c19914de3a13e8e0a20f38622, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:59.190663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:59.202783 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1383/2781] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:48:59 2022] PUT /identity/v3/projects/34a67023bff8489fb3b10d502d5428ec/users/ac51501c19914de3a13e8e0a20f38622/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:48:59.214617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d86b7-7669-47ba-8f2a-ecac3976bd7c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:59.214909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d86b7-7669-47ba-8f2a-ecac3976bd7c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:59.215188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d86b7-7669-47ba-8f2a-ecac3976bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:59.244353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a71d86b7-7669-47ba-8f2a-ecac3976bd7c None None] MFA Rules not processed for user `ac51501c19914de3a13e8e0a20f38622`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:48:59.245628 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a71d86b7-7669-47ba-8f2a-ecac3976bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:59.314233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1399/2782] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:48:59.325652 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:48:59.327776 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:48:59.388441 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ada8-faf3-400a-a327-afc782bfc645 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:48:59.393505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb22c-ccf1-46bf-ad7a-6d37de4a82ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:48:59.394125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb22c-ccf1-46bf-ad7a-6d37de4a82ef service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:48:59.394403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb22c-ccf1-46bf-ad7a-6d37de4a82ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:48:59.394674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb22c-ccf1-46bf-ad7a-6d37de4a82ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:48:59.405099 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bb22c-ccf1-46bf-ad7a-6d37de4a82ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:48:59.406561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bb22c-ccf1-46bf-ad7a-6d37de4a82ef service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:48:59.416288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1384/2783] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:48:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:00.886974 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d86b7-7669-47ba-8f2a-ecac3976bd7c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:00.978322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d86b7-7669-47ba-8f2a-ecac3976bd7c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:00.986633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:00.987602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:00.987964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:00.988311 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] PATH_INFO: `/v3/users/63d2ede26ad3414cb41c0bb8894fd019` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:00.990266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d2ede26ad3414cb41c0bb8894fd019)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:00.993203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:01.047223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d2ede26ad3414cb41c0bb8894fd019'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.048403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:01.055326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d2ede26ad3414cb41c0bb8894fd019'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.065405 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d2ede26ad3414cb41c0bb8894fd019'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.079012 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d2ede26ad3414cb41c0bb8894fd019'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.079659 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d2ede26ad3414cb41c0bb8894fd019'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.085875 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1400/2784] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:00 2022] DELETE /identity/v3/users/63d2ede26ad3414cb41c0bb8894fd019 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:01.092087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:01.092619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:01.092754 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:01.120857 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:01.122113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:01.195242 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1385/2785] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:01.205826 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:01.207647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:01.269243 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00be1a-6e35-4e63-bd35-561b2ce2ad4e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:01.273306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:01.273951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:01.274237 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:01.274515 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:01.284886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:01.286372 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:01.296234 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1401/2786] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:01.571638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:01.573134 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:01.585574 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093676-db0e-490d-b7d6-6285fe5a5f8b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:01.591257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:01.592155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:01.592436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:01.592706 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] PATH_INFO: `/v3/projects/5664cdc009dc467d95bb1bb77708b0bf` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:01.594470 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5664cdc009dc467d95bb1bb77708b0bf)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:01.596675 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:01.646418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5664cdc009dc467d95bb1bb77708b0bf', 'request_id': 'req-4f08e4c6-7464-4042-9296-1697115a774d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.652184 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5664cdc009dc467d95bb1bb77708b0bf', 'request_id': 'req-4f08e4c6-7464-4042-9296-1697115a774d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.661153 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5664cdc009dc467d95bb1bb77708b0bf', 'request_id': 'req-4f08e4c6-7464-4042-9296-1697115a774d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.672998 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] The token cache is being invalidate because project 5664cdc009dc467d95bb1bb77708b0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:01.673315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.674036 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.675680 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1386/2787] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:01 2022] DELETE /identity/v3/projects/5664cdc009dc467d95bb1bb77708b0bf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:01.679817 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:01.690395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596155-d5dc-4bf4-bd1d-49528f1defa5 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:01.747536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:01.748164 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:01.748442 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:01.748713 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] PATH_INFO: `/v3/users/ac51501c19914de3a13e8e0a20f38622` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:01.749924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac51501c19914de3a13e8e0a20f38622)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:01.751845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:01.804856 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac51501c19914de3a13e8e0a20f38622'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.813233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac51501c19914de3a13e8e0a20f38622'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.824226 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac51501c19914de3a13e8e0a20f38622'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.831344 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:01.839554 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac51501c19914de3a13e8e0a20f38622'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.840260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1fad0531-14ef-4a13-a502-c86440a95aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac51501c19914de3a13e8e0a20f38622'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:01.846553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1402/2788] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:01 2022] DELETE /identity/v3/users/ac51501c19914de3a13e8e0a20f38622 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:02.122686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.124215 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:02.139354 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08e4c6-7464-4042-9296-1697115a774d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.156533 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:02.205997 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.206670 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.206951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.207230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] PATH_INFO: `/v3/projects/34a67023bff8489fb3b10d502d5428ec` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.208436 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a67023bff8489fb3b10d502d5428ec)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.210371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.267950 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a67023bff8489fb3b10d502d5428ec', 'request_id': 'req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:02.273760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a67023bff8489fb3b10d502d5428ec', 'request_id': 'req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:02.283721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a67023bff8489fb3b10d502d5428ec', 'request_id': 'req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:02.295919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] The token cache is being invalidate because project 34a67023bff8489fb3b10d502d5428ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:02.296214 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:02.296890 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0cfdecf2-bef8-41f3-8beb-d9c30e4c4592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:02.298500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1387/2789] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:02 2022] DELETE /identity/v3/projects/34a67023bff8489fb3b10d502d5428ec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:02.303483 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42135-e427-4ab0-ac0d-aecd583ee012 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.303986 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42135-e427-4ab0-ac0d-aecd583ee012 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.304098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42135-e427-4ab0-ac0d-aecd583ee012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.324637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8aa42135-e427-4ab0-ac0d-aecd583ee012 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:02.325812 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8aa42135-e427-4ab0-ac0d-aecd583ee012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:02.396228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1403/2790] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:02.404259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdb38-ec20-40fb-b53b-c12cff838bbd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.404548 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdb38-ec20-40fb-b53b-c12cff838bbd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.404838 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdb38-ec20-40fb-b53b-c12cff838bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.427223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f39cdb38-ec20-40fb-b53b-c12cff838bbd None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:02.428457 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f39cdb38-ec20-40fb-b53b-c12cff838bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:02.438347 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1388/2791] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 08:49:02.442763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42135-e427-4ab0-ac0d-aecd583ee012 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.453433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42135-e427-4ab0-ac0d-aecd583ee012 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.458964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.459579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.459861 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.460134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.460829 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:49:02.461131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.462866 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.474680 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1404/2792] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:49:02.479086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdb38-ec20-40fb-b53b-c12cff838bbd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.488452 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdb38-ec20-40fb-b53b-c12cff838bbd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.493881 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.494490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.494764 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.495037 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.495711 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.497619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.528427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1389/2793] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:02 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:02.533743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.544354 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9aca-bd25-4986-a2cb-c21f3ba87f36 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.604553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.605173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.605482 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.605756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.606411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.608342 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.630446 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1405/2794] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:02 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:02.634715 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.645133 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28c08-09a3-4ea3-a608-5e705997d5f7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.650570 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.651192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.651475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.651743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.652469 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.654159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.664416 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1390/2795] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:49:02.668536 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.678676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc30c7b-f9a5-4511-8ff6-1fb030bd4340 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.683902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281ab21-bfec-4891-8b62-8a1a9e55c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.684511 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281ab21-bfec-4891-8b62-8a1a9e55c3be admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.684790 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281ab21-bfec-4891-8b62-8a1a9e55c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.685068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281ab21-bfec-4891-8b62-8a1a9e55c3be admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.685802 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281ab21-bfec-4891-8b62-8a1a9e55c3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.687418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281ab21-bfec-4891-8b62-8a1a9e55c3be admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.698797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1406/2796] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:02.703573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.714038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c567-c218-428c-aedd-6816ce52b02d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.719196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.719891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.720248 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.720529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] PATH_INFO: `/v3/projects/40b19bd4e1b54956ad4f35660139581d/users/76b4aa854ca64cc48dc21a0399872c30/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.735455 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b19bd4e1b54956ad4f35660139581d, user_id=76b4aa854ca64cc48dc21a0399872c30, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.738277 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.752600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1391/2797] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:02 2022] PUT /identity/v3/projects/40b19bd4e1b54956ad4f35660139581d/users/76b4aa854ca64cc48dc21a0399872c30/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:02.765617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eddfb5-6165-47f7-aeba-bc9d3c527842 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.766010 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eddfb5-6165-47f7-aeba-bc9d3c527842 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.766313 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eddfb5-6165-47f7-aeba-bc9d3c527842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.803603 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-50eddfb5-6165-47f7-aeba-bc9d3c527842 None None] MFA Rules not processed for user `76b4aa854ca64cc48dc21a0399872c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:02.804819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-50eddfb5-6165-47f7-aeba-bc9d3c527842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:02.846738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:02.873951 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1407/2798] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:02.878581 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:02.924453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:02.943791 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9322d8-13be-4fae-9dbb-eae43b8f1ade admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:02.948887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:02.949547 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:02.949833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:02.950115 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:02.950815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:02.952729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:02.981336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1392/2799] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:02 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:02.986314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eddfb5-6165-47f7-aeba-bc9d3c527842 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.003435 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eddfb5-6165-47f7-aeba-bc9d3c527842 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.062157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.062773 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.063068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.063327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.063991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.065975 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.089362 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1408/2800] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:02 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:03.093413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.104155 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0b0bd-5f91-4865-8708-f19025ffe5df admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.109254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.109906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.110194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.110505 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.111218 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.112831 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.124279 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1393/2801] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:03.127997 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.142130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb2f0d-e8c6-49b6-b2d9-36cb3eb39e99 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.149710 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790346a-bf07-40fa-a3dd-41d4afc4867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.150423 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790346a-bf07-40fa-a3dd-41d4afc4867d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.150706 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790346a-bf07-40fa-a3dd-41d4afc4867d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.150983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790346a-bf07-40fa-a3dd-41d4afc4867d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.151683 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790346a-bf07-40fa-a3dd-41d4afc4867d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.153322 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790346a-bf07-40fa-a3dd-41d4afc4867d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.163134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1409/2802] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:03.167350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.177448 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bb21-ac83-4235-8345-f2a86989c97f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.182233 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.182899 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.183179 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.183454 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] PATH_INFO: `/v3/projects/e9a1e307d4e844619b0533c459e4d6b1/users/15226118e17d469a8e5f69711f7629c2/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.198485 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a1e307d4e844619b0533c459e4d6b1, user_id=15226118e17d469a8e5f69711f7629c2, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.201141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.217878 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1394/2803] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:03 2022] PUT /identity/v3/projects/e9a1e307d4e844619b0533c459e4d6b1/users/15226118e17d469a8e5f69711f7629c2/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:49:03.228472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ade1-265b-4c5d-b719-1c4a4dd2218f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.228742 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ade1-265b-4c5d-b719-1c4a4dd2218f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.229040 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ade1-265b-4c5d-b719-1c4a4dd2218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.257622 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-59c5ade1-265b-4c5d-b719-1c4a4dd2218f None None] MFA Rules not processed for user `15226118e17d469a8e5f69711f7629c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:03.258880 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-59c5ade1-265b-4c5d-b719-1c4a4dd2218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:03.324123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1410/2804] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:03.329759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.396270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd5cd-0bec-48d6-ae4b-163f0b4a00ff admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.401704 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.402332 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.402624 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.402904 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.403573 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.405515 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.436555 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1395/2805] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:03 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:03.440678 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ade1-265b-4c5d-b719-1c4a4dd2218f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.452094 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ade1-265b-4c5d-b719-1c4a4dd2218f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.499493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:03.509848 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.510480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.510763 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.511041 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.511708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.513698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.537221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1411/2806] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:03 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:03.541519 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.552120 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f1a5-3f00-4dec-ad94-932a6a5fb605 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.557136 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.557782 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.558068 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.558350 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.559042 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.560640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.571479 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1396/2807] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:03.575567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.586359 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399205df-2431-4e8f-8a86-100feb575e25 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.592212 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.592898 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.593168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.593456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] PATH_INFO: `/v3/projects/1d94f9ef81b640df8a57f01f90e510dc/users/7194047eda684eaf91984f94f01a0295/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.608654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d94f9ef81b640df8a57f01f90e510dc, user_id=7194047eda684eaf91984f94f01a0295, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.611357 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.629643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1412/2808] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:03 2022] PUT /identity/v3/projects/1d94f9ef81b640df8a57f01f90e510dc/users/7194047eda684eaf91984f94f01a0295/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:03.634106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.644381 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce44e-c727-4b67-8001-21746198a019 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.706235 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb5e2e-6a95-4505-9d4f-5f29f8551e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.706795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb5e2e-6a95-4505-9d4f-5f29f8551e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.707072 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb5e2e-6a95-4505-9d4f-5f29f8551e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.707351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb5e2e-6a95-4505-9d4f-5f29f8551e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.708048 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb5e2e-6a95-4505-9d4f-5f29f8551e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.709659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb5e2e-6a95-4505-9d4f-5f29f8551e4d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.720741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1397/2809] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:03.724934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.736488 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa65475-42f6-443b-a258-83ec3a06c7c0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.741347 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.742020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.742292 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.742575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] PATH_INFO: `/v3/projects/1d94f9ef81b640df8a57f01f90e510dc/users/7194047eda684eaf91984f94f01a0295/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.744648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d94f9ef81b640df8a57f01f90e510dc, user_id=7194047eda684eaf91984f94f01a0295, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.747431 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.758685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1413/2810] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:03 2022] PUT /identity/v3/projects/1d94f9ef81b640df8a57f01f90e510dc/users/7194047eda684eaf91984f94f01a0295/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:03.769368 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.769665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.769944 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.777683 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:03.801371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] MFA Rules not processed for user `7194047eda684eaf91984f94f01a0295`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:03.802598 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:03.880409 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1398/2811] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:03.891305 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:03.893204 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:03.955280 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d6d2-6e79-464e-9a1a-dac2e1fdc878 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:03.960306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:03.960821 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:03.961099 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:03.961401 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:03.970612 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:03.972061 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:03.981582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1414/2812] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:04.497065 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:04.498725 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:04.511139 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881b3a-aed0-46f6-acf2-582559ae7864 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:04.514842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:04.515461 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:04.515745 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:04.516024 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:04.574205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:04.575649 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:04.585195 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1399/2813] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:08.694153 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:08.703478 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93146-5ff6-42cb-b8d1-ac6f699b652a service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:08.707274 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde66e5-2bc9-4208-8d49-0cd28bbc73f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:08.707877 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde66e5-2bc9-4208-8d49-0cd28bbc73f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:08.708152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde66e5-2bc9-4208-8d49-0cd28bbc73f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:08.708414 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde66e5-2bc9-4208-8d49-0cd28bbc73f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:08.764157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde66e5-2bc9-4208-8d49-0cd28bbc73f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:08.765563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde66e5-2bc9-4208-8d49-0cd28bbc73f5 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:08.774632 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1415/2814] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:10.968590 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:11.034490 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb130ae-57c3-4bb4-8b6d-bc2978aa157c service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:11.039674 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:11.040320 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:11.040606 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:11.040886 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] PATH_INFO: `/v3/users/76b4aa854ca64cc48dc21a0399872c30` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:11.042107 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b4aa854ca64cc48dc21a0399872c30)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:11.044038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:11.080850 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:11.104014 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b4aa854ca64cc48dc21a0399872c30'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.113352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b4aa854ca64cc48dc21a0399872c30'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.125308 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b4aa854ca64cc48dc21a0399872c30'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.131967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b4aa854ca64cc48dc21a0399872c30'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.132526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b4aa854ca64cc48dc21a0399872c30'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.138397 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1400/2815] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:10 2022] DELETE /identity/v3/users/76b4aa854ca64cc48dc21a0399872c30 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:11.143069 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:11.143580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:11.143580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:11.162896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:11.164113 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:11.206562 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:11.230257 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1416/2816] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:11.240104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:11.241746 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:11.298916 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddb2d3-a259-4f1f-ba34-226abc256653 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:11.303478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:11.304100 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:11.304390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:11.304667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:11.314786 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:11.316219 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:11.326900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1401/2817] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:11.626623 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:11.628160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:11.643046 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dcc3b-8add-47a1-9f67-4ea02e2e3ca4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:11.648855 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:11.649779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:11.650053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:11.650350 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] PATH_INFO: `/v3/projects/40b19bd4e1b54956ad4f35660139581d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:11.651579 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b19bd4e1b54956ad4f35660139581d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:11.653596 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:11.720155 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b19bd4e1b54956ad4f35660139581d', 'request_id': 'req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.729798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b19bd4e1b54956ad4f35660139581d', 'request_id': 'req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.736438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b19bd4e1b54956ad4f35660139581d', 'request_id': 'req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.748955 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] The token cache is being invalidate because project 40b19bd4e1b54956ad4f35660139581d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:11.749246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.750033 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.751691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1417/2818] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:11 2022] DELETE /identity/v3/projects/40b19bd4e1b54956ad4f35660139581d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:11.755884 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:11.765955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833d6f-0a45-4db4-a662-863679c6b371 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:11.835812 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:11.836463 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:11.836748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:11.837025 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] PATH_INFO: `/v3/users/15226118e17d469a8e5f69711f7629c2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:11.838246 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15226118e17d469a8e5f69711f7629c2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:11.840259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:11.906164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15226118e17d469a8e5f69711f7629c2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.908867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:11.915556 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15226118e17d469a8e5f69711f7629c2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.928611 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15226118e17d469a8e5f69711f7629c2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.935491 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15226118e17d469a8e5f69711f7629c2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.936124 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15226118e17d469a8e5f69711f7629c2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:11.941990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1402/2819] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:11 2022] DELETE /identity/v3/users/15226118e17d469a8e5f69711f7629c2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:12.226568 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:12.228813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:12.249505 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec39e7-adc0-4806-94f7-5a52c01d6a52 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:12.306251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:12.306859 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:12.307065 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:12.307352 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] PATH_INFO: `/v3/projects/e9a1e307d4e844619b0533c459e4d6b1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:12.308502 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a1e307d4e844619b0533c459e4d6b1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:12.310492 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:12.358652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a1e307d4e844619b0533c459e4d6b1', 'request_id': 'req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.367797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a1e307d4e844619b0533c459e4d6b1', 'request_id': 'req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.373573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a1e307d4e844619b0533c459e4d6b1', 'request_id': 'req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.380801 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:12.386271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] The token cache is being invalidate because project e9a1e307d4e844619b0533c459e4d6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:12.386872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.387617 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.389306 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1418/2820] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:12 2022] DELETE /identity/v3/projects/e9a1e307d4e844619b0533c459e4d6b1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:12.393892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:12.395369 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:12.408866 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527650b3-837b-4375-a400-ed6e634caa1e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:12.467818 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:12.468460 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:12.468741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:12.469015 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] PATH_INFO: `/v3/users/7194047eda684eaf91984f94f01a0295` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:12.470303 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7194047eda684eaf91984f94f01a0295)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:12.472227 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:12.531723 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7194047eda684eaf91984f94f01a0295'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.540511 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7194047eda684eaf91984f94f01a0295'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.552352 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7194047eda684eaf91984f94f01a0295'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.560061 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7194047eda684eaf91984f94f01a0295'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.560753 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-aaa5035c-3e18-440d-b726-e5f07ac3e085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7194047eda684eaf91984f94f01a0295'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.567060 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1403/2821] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:12 2022] DELETE /identity/v3/users/7194047eda684eaf91984f94f01a0295 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:49:12.845712 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:12.847180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:12.862188 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d944ab-2bbe-42ce-bb0b-b5708bc877ff admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:12.919925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:12.920567 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:12.920832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:12.921118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] PATH_INFO: `/v3/projects/1d94f9ef81b640df8a57f01f90e510dc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:12.922307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d94f9ef81b640df8a57f01f90e510dc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:12.924230 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:12.970186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d94f9ef81b640df8a57f01f90e510dc', 'request_id': 'req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.978871 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d94f9ef81b640df8a57f01f90e510dc', 'request_id': 'req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.984728 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d94f9ef81b640df8a57f01f90e510dc', 'request_id': 'req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.995276 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] The token cache is being invalidate because project 1d94f9ef81b640df8a57f01f90e510dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:12.995563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.996181 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-383c5bd4-a3e8-4a1c-ab74-8f1d676e877c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:12.997758 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1419/2822] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:12 2022] DELETE /identity/v3/projects/1d94f9ef81b640df8a57f01f90e510dc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:13.004012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d3237-32bb-4840-baf9-bcfef883aceb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.004336 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d3237-32bb-4840-baf9-bcfef883aceb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.004703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d3237-32bb-4840-baf9-bcfef883aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.025315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-197d3237-32bb-4840-baf9-bcfef883aceb None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:13.026578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-197d3237-32bb-4840-baf9-bcfef883aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:13.071205 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:13.091596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1404/2823] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:13.100417 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd9d4-7c6c-43ec-a206-f62d08b9ca67 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.100792 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd9d4-7c6c-43ec-a206-f62d08b9ca67 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.101075 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd9d4-7c6c-43ec-a206-f62d08b9ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.122158 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-62cdd9d4-7c6c-43ec-a206-f62d08b9ca67 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:13.123449 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-62cdd9d4-7c6c-43ec-a206-f62d08b9ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:13.132966 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1420/2824] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:13.137243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d3237-32bb-4840-baf9-bcfef883aceb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.147243 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d3237-32bb-4840-baf9-bcfef883aceb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.152477 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.153086 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.153393 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.153763 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.154473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:49:13.154772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.156373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.168057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1405/2825] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:49:13.172501 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdd9d4-7c6c-43ec-a206-f62d08b9ca67 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.182329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdd9d4-7c6c-43ec-a206-f62d08b9ca67 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.188083 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.188701 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.188983 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.189246 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.189957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.191872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.225273 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1421/2826] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:13 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:13.231113 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.243356 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a61d6-d6d0-4ead-9db1-53e99dd2ad6c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.306466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.307138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.307417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.307709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.308401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.310427 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.333176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1406/2827] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:13 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:13.337648 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.348508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33633-4da6-4931-b996-7f7eefa80ad2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.354288 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.354908 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.355218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.355491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.356192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.357909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.368633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1422/2828] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:13.373006 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.383597 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02fba-ad39-4f1c-95bd-74d5abea87a1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.389163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9e275-05a5-4715-a861-91b90d41581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.389842 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e275-05a5-4715-a861-91b90d41581f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.390125 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e275-05a5-4715-a861-91b90d41581f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.390403 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e275-05a5-4715-a861-91b90d41581f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.391083 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9e275-05a5-4715-a861-91b90d41581f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.392698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9e275-05a5-4715-a861-91b90d41581f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.403743 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1407/2829] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:13.408182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.419373 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be7acb-e27f-49ca-bcce-448fdb719dec admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.424650 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.425325 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.425629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.425906 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] PATH_INFO: `/v3/projects/b8a0bff2b5b744ae9dc60db5efb0d3d7/users/ba423899b17245f69d71b17246be87fb/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.442525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a0bff2b5b744ae9dc60db5efb0d3d7, user_id=ba423899b17245f69d71b17246be87fb, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.445192 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.461441 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1423/2830] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:13 2022] PUT /identity/v3/projects/b8a0bff2b5b744ae9dc60db5efb0d3d7/users/ba423899b17245f69d71b17246be87fb/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:13.473602 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc585a5-8e96-425e-9ad7-3ffa66165a7e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.473918 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc585a5-8e96-425e-9ad7-3ffa66165a7e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.474220 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc585a5-8e96-425e-9ad7-3ffa66165a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.509326 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9dc585a5-8e96-425e-9ad7-3ffa66165a7e None None] MFA Rules not processed for user `ba423899b17245f69d71b17246be87fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:13.510564 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9dc585a5-8e96-425e-9ad7-3ffa66165a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:13.575196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1408/2831] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:13.580321 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.607644 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:13.648159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6db728-5415-41b5-bbcd-19a4f3a9325c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.653472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.654095 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.654377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.654649 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.655312 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.657223 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.687013 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1424/2832] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:13 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:13.693375 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc585a5-8e96-425e-9ad7-3ffa66165a7e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.708012 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc585a5-8e96-425e-9ad7-3ffa66165a7e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.749648 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:13.766592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.767212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.767496 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.767774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.768442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.770478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.792334 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1409/2833] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:13 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:49:13.797123 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.813168 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae34edf-b246-4ce5-ae3c-916ac755937d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.820901 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.821784 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.822131 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.822528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.823573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.825779 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.837082 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1425/2834] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:13.841402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.851638 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70313ff-3d37-4ac6-a101-acab69fc02a1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.856793 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.857475 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.857822 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.858038 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] PATH_INFO: `/v3/projects/37d300cc519c469b8d3ed2b6ff37f9b7/users/40588c60c90f4407a90b73a1e5cd539a/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.876088 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d300cc519c469b8d3ed2b6ff37f9b7, user_id=40588c60c90f4407a90b73a1e5cd539a, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.878770 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.895821 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1410/2835] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:13 2022] PUT /identity/v3/projects/37d300cc519c469b8d3ed2b6ff37f9b7/users/40588c60c90f4407a90b73a1e5cd539a/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:13.900019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:13.911799 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9883-18b0-46b9-8cdd-a5ff8c7d3a2c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:13.976703 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8363e89-cbc7-4cec-aedb-14f97bf74804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:13.977328 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363e89-cbc7-4cec-aedb-14f97bf74804 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:13.977633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363e89-cbc7-4cec-aedb-14f97bf74804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:13.977959 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363e89-cbc7-4cec-aedb-14f97bf74804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:13.978657 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8363e89-cbc7-4cec-aedb-14f97bf74804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:13.980340 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8363e89-cbc7-4cec-aedb-14f97bf74804 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:13.990469 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1426/2836] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:13.994759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:14.005531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dd02d-596c-4680-92cd-2fd2fe3e9471 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:14.010560 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:14.011221 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:14.011500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:14.011774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] PATH_INFO: `/v3/projects/37d300cc519c469b8d3ed2b6ff37f9b7/users/40588c60c90f4407a90b73a1e5cd539a/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:14.014004 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d300cc519c469b8d3ed2b6ff37f9b7, user_id=40588c60c90f4407a90b73a1e5cd539a, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:14.016640 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:14.028017 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1411/2837] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:13 2022] PUT /identity/v3/projects/37d300cc519c469b8d3ed2b6ff37f9b7/users/40588c60c90f4407a90b73a1e5cd539a/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:14.039598 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c40f-d6a6-4724-b972-831859971df5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:14.039888 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c40f-d6a6-4724-b972-831859971df5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:14.040173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c40f-d6a6-4724-b972-831859971df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:14.068699 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d155c40f-d6a6-4724-b972-831859971df5 None None] MFA Rules not processed for user `40588c60c90f4407a90b73a1e5cd539a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:14.069930 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d155c40f-d6a6-4724-b972-831859971df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:14.138326 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1427/2838] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:14.149250 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:14.151069 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:14.212957 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3e1a5-affd-44c0-832e-6a527ca2d065 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:14.217832 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11fb47-4eaa-40b6-be00-38cca1c94a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:14.218453 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11fb47-4eaa-40b6-be00-38cca1c94a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:14.218731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11fb47-4eaa-40b6-be00-38cca1c94a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:14.219013 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11fb47-4eaa-40b6-be00-38cca1c94a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:14.229592 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11fb47-4eaa-40b6-be00-38cca1c94a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:14.231360 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11fb47-4eaa-40b6-be00-38cca1c94a58 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:14.243493 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1412/2839] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:14.392009 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c40f-d6a6-4724-b972-831859971df5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:14.417833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:14.464252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c40f-d6a6-4724-b972-831859971df5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:14.468939 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:14.469616 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:14.469895 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:14.470174 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] PATH_INFO: `/v3/users/ba423899b17245f69d71b17246be87fb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:14.471329 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba423899b17245f69d71b17246be87fb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:14.473271 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:14.520798 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba423899b17245f69d71b17246be87fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:14.527573 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba423899b17245f69d71b17246be87fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:14.536159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba423899b17245f69d71b17246be87fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:14.548068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba423899b17245f69d71b17246be87fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:14.548690 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba423899b17245f69d71b17246be87fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:14.554510 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1428/2840] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:14 2022] DELETE /identity/v3/users/ba423899b17245f69d71b17246be87fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:14.559161 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:14.559639 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:14.559803 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:14.579543 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:14.580767 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:14.642714 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1413/2841] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:14.652691 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:14.654493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:14.724146 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fb4f-678c-4aaf-bec4-486de6083f83 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:14.728591 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:14.729219 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:14.729538 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:14.729845 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:14.739714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:14.741165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:14.750964 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1429/2842] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:15.032610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:15.034168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:15.048518 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66289532-fb77-4958-bbb6-39d844bef324 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:15.053757 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:15.054421 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:15.054734 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:15.055002 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] PATH_INFO: `/v3/projects/b8a0bff2b5b744ae9dc60db5efb0d3d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:15.056244 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a0bff2b5b744ae9dc60db5efb0d3d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:15.058202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:15.102963 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:15.118081 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a0bff2b5b744ae9dc60db5efb0d3d7', 'request_id': 'req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.123750 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a0bff2b5b744ae9dc60db5efb0d3d7', 'request_id': 'req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.131814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a0bff2b5b744ae9dc60db5efb0d3d7', 'request_id': 'req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.143815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] The token cache is being invalidate because project b8a0bff2b5b744ae9dc60db5efb0d3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:15.144112 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.144841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.146604 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1414/2843] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:15 2022] DELETE /identity/v3/projects/b8a0bff2b5b744ae9dc60db5efb0d3d7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:15.150846 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:15.160988 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243503e-a65b-4a0f-b652-104767a5a4d3 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:15.202218 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:15.220019 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:15.220698 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:15.220981 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:15.221259 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] PATH_INFO: `/v3/users/40588c60c90f4407a90b73a1e5cd539a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:15.222460 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40588c60c90f4407a90b73a1e5cd539a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:15.224395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:15.274451 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40588c60c90f4407a90b73a1e5cd539a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.281138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40588c60c90f4407a90b73a1e5cd539a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.290764 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40588c60c90f4407a90b73a1e5cd539a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.304833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40588c60c90f4407a90b73a1e5cd539a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.305516 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5b144251-f246-48f2-a879-d65b54411d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40588c60c90f4407a90b73a1e5cd539a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.311746 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1430/2844] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:15 2022] DELETE /identity/v3/users/40588c60c90f4407a90b73a1e5cd539a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:15.588196 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:15.589740 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:15.606027 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ddd6-c84f-4e75-b4fd-6a3d9a81f940 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:15.667577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:15.668143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:15.668426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:15.668703 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] PATH_INFO: `/v3/projects/37d300cc519c469b8d3ed2b6ff37f9b7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:15.669935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d300cc519c469b8d3ed2b6ff37f9b7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:15.671891 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:15.722977 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d300cc519c469b8d3ed2b6ff37f9b7', 'request_id': 'req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.728691 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d300cc519c469b8d3ed2b6ff37f9b7', 'request_id': 'req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.739077 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d300cc519c469b8d3ed2b6ff37f9b7', 'request_id': 'req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.751312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] The token cache is being invalidate because project 37d300cc519c469b8d3ed2b6ff37f9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:15.751600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.752327 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-de67f2c8-2b87-4aa8-8437-1e6e8ed3e6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:15.753919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1415/2845] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:15 2022] DELETE /identity/v3/projects/37d300cc519c469b8d3ed2b6ff37f9b7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:15.761636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7423a-efe5-4432-9be6-a9caf2ba5870 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:15.762177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7423a-efe5-4432-9be6-a9caf2ba5870 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:15.762177 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7423a-efe5-4432-9be6-a9caf2ba5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:15.783089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d1e7423a-efe5-4432-9be6-a9caf2ba5870 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:15.784294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d1e7423a-efe5-4432-9be6-a9caf2ba5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:15.846582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1431/2846] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:15.854594 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5379-25f4-4dba-b9aa-267fb019e1c7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:15.854906 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5379-25f4-4dba-b9aa-267fb019e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:15.855190 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5379-25f4-4dba-b9aa-267fb019e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:15.874971 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b6cd5379-25f4-4dba-b9aa-267fb019e1c7 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:15.876188 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b6cd5379-25f4-4dba-b9aa-267fb019e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:15.885982 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1416/2847] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:15.892428 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7423a-efe5-4432-9be6-a9caf2ba5870 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:15.907800 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7423a-efe5-4432-9be6-a9caf2ba5870 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:15.916006 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:15.916937 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:15.917327 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:15.917809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:15.918787 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:49:15.919228 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:15.921211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:15.933470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1432/2848] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:49:15.938020 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5379-25f4-4dba-b9aa-267fb019e1c7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:15.947805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5379-25f4-4dba-b9aa-267fb019e1c7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:15.954297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:15.954914 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:15.955194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:15.955466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:15.956141 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:15.958097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:15.992223 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1417/2849] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:15 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:15.998667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.013934 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2200da4-8fa4-4e73-89bd-687a9dd8768b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.058640 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:16.072594 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.073213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.073525 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.073806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.074465 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.076473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.100160 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1433/2850] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:15 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:16.104579 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.115259 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5452-1c8d-4f5d-a50d-03ed54acb784 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.120087 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.120701 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.120983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.121261 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.121990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.123664 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.134034 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1418/2851] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:16.138142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.149902 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18169eda-e373-4ffc-a962-a97ef39cff78 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.155991 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56103629-63db-46c2-9dcf-7860286c07fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.156643 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56103629-63db-46c2-9dcf-7860286c07fb admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.156925 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56103629-63db-46c2-9dcf-7860286c07fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.157197 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56103629-63db-46c2-9dcf-7860286c07fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.157943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56103629-63db-46c2-9dcf-7860286c07fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.159575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56103629-63db-46c2-9dcf-7860286c07fb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.170973 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1434/2852] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:49:16.175268 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.186150 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990a68-fee0-4040-b2fd-e4f7d6ac10b7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.192005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.192665 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.192935 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.193240 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] PATH_INFO: `/v3/projects/fe6bb06c18e1450b93f4401395c00852/users/b94885a42b5642c98c7903294d984006/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.201919 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:16.209342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6bb06c18e1450b93f4401395c00852, user_id=b94885a42b5642c98c7903294d984006, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.212852 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.227744 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1419/2853] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:16 2022] PUT /identity/v3/projects/fe6bb06c18e1450b93f4401395c00852/users/b94885a42b5642c98c7903294d984006/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:16.238374 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18e376-5571-4008-98b8-508fae16985c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.238636 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18e376-5571-4008-98b8-508fae16985c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.238944 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18e376-5571-4008-98b8-508fae16985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.268805 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3b18e376-5571-4008-98b8-508fae16985c None None] MFA Rules not processed for user `b94885a42b5642c98c7903294d984006`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:16.270242 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3b18e376-5571-4008-98b8-508fae16985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:16.342929 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1435/2854] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:16.347721 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.420431 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30272230-e2aa-454f-b426-3c4e870568ad admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.425901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.426459 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.426729 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.426996 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.427669 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.429595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.460600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1420/2855] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:16 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:16.464750 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18e376-5571-4008-98b8-508fae16985c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.475523 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18e376-5571-4008-98b8-508fae16985c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.539872 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.540738 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.541093 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.541461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.542418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.545433 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.569756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1436/2856] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:16 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:16.573887 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.585122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003776-eadd-45f3-9433-1424f6eefbe8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.591095 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.591735 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.591978 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.592251 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.592952 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.594610 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.605784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1421/2857] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:16.610297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.620864 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2f07-e8eb-4f79-8b39-6aded054a4e5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.626129 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.626684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.627078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.627214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] PATH_INFO: `/v3/projects/b93378cc9ddb4a798ec481218b2a07b2/users/6aebf02036b345c096a731a76b4494c2/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.642672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93378cc9ddb4a798ec481218b2a07b2, user_id=6aebf02036b345c096a731a76b4494c2, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.645395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.659831 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1437/2858] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:16 2022] PUT /identity/v3/projects/b93378cc9ddb4a798ec481218b2a07b2/users/6aebf02036b345c096a731a76b4494c2/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:16.663892 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.674698 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d7efb-0eef-43c9-8f46-8246d612a65f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.734962 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ee058-0fb0-44c7-ac9b-d5849ee626fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.735532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ee058-0fb0-44c7-ac9b-d5849ee626fe admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.735814 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ee058-0fb0-44c7-ac9b-d5849ee626fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.736117 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ee058-0fb0-44c7-ac9b-d5849ee626fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.736811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ee058-0fb0-44c7-ac9b-d5849ee626fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.738424 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ee058-0fb0-44c7-ac9b-d5849ee626fe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.748951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1422/2859] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:16.753269 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.764005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8ac7-daf9-4dc2-b850-b2674bf36a97 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.769210 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.769907 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.770184 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.770456 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] PATH_INFO: `/v3/projects/b93378cc9ddb4a798ec481218b2a07b2/users/6aebf02036b345c096a731a76b4494c2/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.772513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93378cc9ddb4a798ec481218b2a07b2, user_id=6aebf02036b345c096a731a76b4494c2, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.775186 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:16.785853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1438/2860] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:16 2022] PUT /identity/v3/projects/b93378cc9ddb4a798ec481218b2a07b2/users/6aebf02036b345c096a731a76b4494c2/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:16.796903 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99376-9e4f-440e-8f9d-417fbe4f538b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.797192 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99376-9e4f-440e-8f9d-417fbe4f538b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.797504 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99376-9e4f-440e-8f9d-417fbe4f538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.825926 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-23a99376-9e4f-440e-8f9d-417fbe4f538b None None] MFA Rules not processed for user `6aebf02036b345c096a731a76b4494c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:16.827212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-23a99376-9e4f-440e-8f9d-417fbe4f538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:16.874365 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:16.899948 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1423/2861] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:16.912475 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:16.914323 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:16.925421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:16.974221 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61811b-c5c1-42ea-b170-c1e001bad688 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:16.978418 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:16.979034 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:16.979315 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:16.979589 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:16.990268 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:16.991682 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:17.001832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1439/2862] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:17.087967 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99376-9e4f-440e-8f9d-417fbe4f538b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:17.098528 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99376-9e4f-440e-8f9d-417fbe4f538b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:17.102512 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4e62a-5467-40dc-9845-a923c133c58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:17.103132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e62a-5467-40dc-9845-a923c133c58a service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:17.103414 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e62a-5467-40dc-9845-a923c133c58a service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:17.103692 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e62a-5467-40dc-9845-a923c133c58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:17.162011 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4e62a-5467-40dc-9845-a923c133c58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:17.163433 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4e62a-5467-40dc-9845-a923c133c58a service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:17.172270 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1424/2863] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:22.141384 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:22.204939 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951dc9c-de76-4425-bf0f-c610b6712c07 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:22.210386 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:22.211028 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:22.211308 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:22.211590 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] PATH_INFO: `/v3/users/b94885a42b5642c98c7903294d984006` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:22.212896 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94885a42b5642c98c7903294d984006)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:22.214899 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:22.263319 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94885a42b5642c98c7903294d984006'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.270213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94885a42b5642c98c7903294d984006'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.278134 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94885a42b5642c98c7903294d984006'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.292860 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94885a42b5642c98c7903294d984006'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.293613 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94885a42b5642c98c7903294d984006'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.299574 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1440/2864] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:22 2022] DELETE /identity/v3/users/b94885a42b5642c98c7903294d984006 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:22.304229 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:22.304762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:22.304762 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:22.325806 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:22.327049 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:22.392870 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1425/2865] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:22.405141 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:22.407053 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:22.443684 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:22.470604 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45129769-0de7-487b-914b-94d3b3c23c7a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:22.474508 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:22.475130 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:22.475411 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:22.475687 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:22.485182 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:22.486670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:22.496220 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1441/2866] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:22.784216 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:22.785819 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:22.800517 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d476d8-d0bd-4370-a675-d2cb66207fee None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:22.805801 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:22.806456 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:22.806853 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:22.807138 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] PATH_INFO: `/v3/projects/fe6bb06c18e1450b93f4401395c00852` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:22.809173 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6bb06c18e1450b93f4401395c00852)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:22.811090 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:22.859523 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6bb06c18e1450b93f4401395c00852', 'request_id': 'req-630204ea-0639-4acb-8504-cd82ae378214'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.865404 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6bb06c18e1450b93f4401395c00852', 'request_id': 'req-630204ea-0639-4acb-8504-cd82ae378214'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.874696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6bb06c18e1450b93f4401395c00852', 'request_id': 'req-630204ea-0639-4acb-8504-cd82ae378214'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.886371 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] The token cache is being invalidate because project fe6bb06c18e1450b93f4401395c00852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:22.886663 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.887313 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:22.888840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1426/2867] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:22 2022] DELETE /identity/v3/projects/fe6bb06c18e1450b93f4401395c00852 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:22.892914 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:22.902853 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7636a3e-f544-4521-b816-e1b3369a1cc7 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:22.960774 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:22.961457 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:22.961736 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:22.962014 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] PATH_INFO: `/v3/users/6aebf02036b345c096a731a76b4494c2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:22.963214 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aebf02036b345c096a731a76b4494c2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:22.965195 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.011820 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aebf02036b345c096a731a76b4494c2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.018847 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aebf02036b345c096a731a76b4494c2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.026068 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aebf02036b345c096a731a76b4494c2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.038294 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aebf02036b345c096a731a76b4494c2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.038852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1403016c-af38-4528-8636-01343421ac06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aebf02036b345c096a731a76b4494c2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.044833 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1442/2868] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:22 2022] DELETE /identity/v3/users/6aebf02036b345c096a731a76b4494c2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:23.319176 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:23.320836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:23.332478 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:23.337106 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630204ea-0639-4acb-8504-cd82ae378214 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:23.399418 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:23.400063 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.400343 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.400618 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] PATH_INFO: `/v3/projects/b93378cc9ddb4a798ec481218b2a07b2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.401845 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93378cc9ddb4a798ec481218b2a07b2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:23.403748 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.451413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93378cc9ddb4a798ec481218b2a07b2', 'request_id': 'req-04414dc4-0dde-4690-9e24-898d60a0e316'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.457616 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93378cc9ddb4a798ec481218b2a07b2', 'request_id': 'req-04414dc4-0dde-4690-9e24-898d60a0e316'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.466212 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93378cc9ddb4a798ec481218b2a07b2', 'request_id': 'req-04414dc4-0dde-4690-9e24-898d60a0e316'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.477815 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] The token cache is being invalidate because project b93378cc9ddb4a798ec481218b2a07b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:23.478108 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.478761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-04414dc4-0dde-4690-9e24-898d60a0e316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:23.480299 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1427/2869] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:23 2022] DELETE /identity/v3/projects/b93378cc9ddb4a798ec481218b2a07b2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:23.485396 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae835f6e-a82d-4823-a1b2-1139525830e0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.485917 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae835f6e-a82d-4823-a1b2-1139525830e0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.486029 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae835f6e-a82d-4823-a1b2-1139525830e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.505493 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ae835f6e-a82d-4823-a1b2-1139525830e0 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:23.506714 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ae835f6e-a82d-4823-a1b2-1139525830e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:23.555353 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:23.569989 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1443/2870] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:23.578773 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e48d-f877-4e5a-967d-fa577927cc38 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.579059 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e48d-f877-4e5a-967d-fa577927cc38 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.579342 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e48d-f877-4e5a-967d-fa577927cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.600341 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8931e48d-f877-4e5a-967d-fa577927cc38 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:23.601620 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8931e48d-f877-4e5a-967d-fa577927cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:23.610760 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1428/2871] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:23.615375 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae835f6e-a82d-4823-a1b2-1139525830e0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:23.625438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae835f6e-a82d-4823-a1b2-1139525830e0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:23.630916 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:23.631526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.631809 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.632074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.632780 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 08:49:23.633080 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:23.634756 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.647084 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1444/2872] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Jul 29 08:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 08:49:23.651443 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931e48d-f877-4e5a-967d-fa577927cc38 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:23.665879 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931e48d-f877-4e5a-967d-fa577927cc38 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:23.671841 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:23.672466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.672752 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.673030 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.673761 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:23.675705 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.708955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1429/2873] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:23 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:49:23.715658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:23.727512 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab398c-c76d-45fb-bebd-efd2499d18ae admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:23.786718 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:23.787332 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.787637 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.787911 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.788588 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:23.790531 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.815104 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1445/2874] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:23 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:23.819230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:23.830359 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8afa0-50d6-4359-a57e-4fdc7091fb0e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:23.836172 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:23.836789 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.837073 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.837391 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.838101 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:23.839717 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.850297 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1430/2875] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:23.854314 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:23.864719 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc71f0-ec9d-44cc-9963-01709bb7ff80 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:23.869652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e25fc6-3630-4826-8a06-982f8bc48551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:23.870266 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25fc6-3630-4826-8a06-982f8bc48551 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.870553 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25fc6-3630-4826-8a06-982f8bc48551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.870832 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25fc6-3630-4826-8a06-982f8bc48551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.871533 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e25fc6-3630-4826-8a06-982f8bc48551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:23.873149 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e25fc6-3630-4826-8a06-982f8bc48551 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.884124 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1446/2876] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:23.888194 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:23.898278 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac188cd-7e3a-45b3-8210-d3aed583915f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:23.903466 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:23.904122 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.904410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.904696 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] PATH_INFO: `/v3/projects/99dba8222b004b8e83268f540f8a4422/users/4246f6650f82459881b431db8859b580/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.920951 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dba8222b004b8e83268f540f8a4422, user_id=4246f6650f82459881b431db8859b580, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:23.923650 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:23.942867 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1431/2877] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:23 2022] PUT /identity/v3/projects/99dba8222b004b8e83268f540f8a4422/users/4246f6650f82459881b431db8859b580/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 08:49:23.955741 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8fd66-8583-47b8-831e-32219cb774eb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:23.956152 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8fd66-8583-47b8-831e-32219cb774eb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:23.956580 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8fd66-8583-47b8-831e-32219cb774eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:23.995685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0df8fd66-8583-47b8-831e-32219cb774eb None None] MFA Rules not processed for user `4246f6650f82459881b431db8859b580`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:23.996926 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0df8fd66-8583-47b8-831e-32219cb774eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:24.078647 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1447/2878] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:24.083328 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.119159 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:24.151990 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b203b5-7ee4-48e0-87fa-f1aa98438ee6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.157765 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.158400 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.158689 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.158972 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.159646 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.161596 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.198578 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1432/2879] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:24 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:24.202992 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8fd66-8583-47b8-831e-32219cb774eb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.214910 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8fd66-8583-47b8-831e-32219cb774eb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.264128 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:24.277762 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.278397 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.278688 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.278957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.279629 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.281715 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.305941 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1448/2880] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:24 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:24.309993 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.320900 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa2c7-0849-4a1a-a594-82870b715d09 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.325644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.326282 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.326561 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.326839 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.327647 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.329728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.341003 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1433/2881] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:24.345098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.355247 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c4a54-3c69-4327-8405-f58d3508d5ee admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.360203 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32882cd8-5e69-40c9-88d5-e38a3c40ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.360793 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32882cd8-5e69-40c9-88d5-e38a3c40ca19 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.361078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32882cd8-5e69-40c9-88d5-e38a3c40ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.361376 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32882cd8-5e69-40c9-88d5-e38a3c40ca19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.362072 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32882cd8-5e69-40c9-88d5-e38a3c40ca19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.363685 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32882cd8-5e69-40c9-88d5-e38a3c40ca19 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.373783 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1449/2882] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:24.377827 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.387728 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a048b34-aa2f-46a1-82b4-f6067b2bac9a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.392426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.393079 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.393392 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.393667 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] PATH_INFO: `/v3/projects/dd065a10efe945888f2cc806d542ff34/users/f52052ef0aa843a3a8427fdfb676e637/roles/bd4182637160412da90e2d257ec550ce` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.408847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd065a10efe945888f2cc806d542ff34, user_id=f52052ef0aa843a3a8427fdfb676e637, role_id=bd4182637160412da90e2d257ec550ce)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.411571 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.428398 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1434/2883] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:24 2022] PUT /identity/v3/projects/dd065a10efe945888f2cc806d542ff34/users/f52052ef0aa843a3a8427fdfb676e637/roles/bd4182637160412da90e2d257ec550ce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:24.439377 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2f9e-d159-4269-ba46-5b5a61cbdf5a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.439676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2f9e-d159-4269-ba46-5b5a61cbdf5a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.439954 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2f9e-d159-4269-ba46-5b5a61cbdf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.468942 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eeeb2f9e-d159-4269-ba46-5b5a61cbdf5a None None] MFA Rules not processed for user `f52052ef0aa843a3a8427fdfb676e637`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:24.470198 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eeeb2f9e-d159-4269-ba46-5b5a61cbdf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:24.537633 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1450/2884] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:24.542428 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.608288 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388170-ce6f-4752-a9af-c7b52aefb2ef admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.613413 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.614040 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.614322 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.614595 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.615257 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.617168 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.646132 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1435/2885] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Jul 29 08:49:24 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 08:49:24.650395 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb2f9e-d159-4269-ba46-5b5a61cbdf5a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.661838 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb2f9e-d159-4269-ba46-5b5a61cbdf5a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.721610 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.722244 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.722526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.722803 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.723491 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.725461 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.747696 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1451/2886] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Jul 29 08:49:24 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 08:49:24.751738 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.762008 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b53430-d0fe-40af-8f20-9a4887e472f4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.766784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.767399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.767684 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.767965 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.768668 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.770315 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.781104 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1436/2887] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 08:49:24.785229 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.795749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa60ebb-702a-4ca9-9a66-52dbe0925195 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.800806 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.801521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.801810 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.802089 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] PATH_INFO: `/v3/projects/124566a2cfa74950b4352eb0f76aa98c/users/9de23d6dba864da7834c55d7b24d3e68/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.819406 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124566a2cfa74950b4352eb0f76aa98c, user_id=9de23d6dba864da7834c55d7b24d3e68, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.822157 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.836564 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1452/2888] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:24 2022] PUT /identity/v3/projects/124566a2cfa74950b4352eb0f76aa98c/users/9de23d6dba864da7834c55d7b24d3e68/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:24.840687 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.850986 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b021-6752-45b0-a4a9-f3f372ce723e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.903805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:24.915254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94e703-6205-4a6e-8478-07fd888225ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.916164 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94e703-6205-4a6e-8478-07fd888225ab admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.917056 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94e703-6205-4a6e-8478-07fd888225ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.917489 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94e703-6205-4a6e-8478-07fd888225ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.918600 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94e703-6205-4a6e-8478-07fd888225ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.921577 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94e703-6205-4a6e-8478-07fd888225ab admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.932329 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1437/2889] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Jul 29 08:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 08:49:24.936868 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:24.947664 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123caac-e275-4586-a0fa-7ce1b4c19e42 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:24.952993 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:24.954018 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.954297 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.954563 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] PATH_INFO: `/v3/projects/124566a2cfa74950b4352eb0f76aa98c/users/9de23d6dba864da7834c55d7b24d3e68/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:24.956582 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124566a2cfa74950b4352eb0f76aa98c, user_id=9de23d6dba864da7834c55d7b24d3e68, role_id=8b25e1d3eeed4a55aa0d9f8cfff30a8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:24.959258 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:24.970036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1453/2890] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Jul 29 08:49:24 2022] PUT /identity/v3/projects/124566a2cfa74950b4352eb0f76aa98c/users/9de23d6dba864da7834c55d7b24d3e68/roles/8b25e1d3eeed4a55aa0d9f8cfff30a8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:24.980442 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:24.980731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:24.981005 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:25.009262 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] MFA Rules not processed for user `9de23d6dba864da7834c55d7b24d3e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:25.010500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:25.082451 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1438/2891] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:25.094398 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:25.096489 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:25.108383 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:25.157005 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9e77-9924-4ed5-b6a6-af17a8c3ceb2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:25.160943 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:25.161572 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:25.161851 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:25.162118 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:25.219055 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:25.220513 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:25.229602 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1454/2892] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:26.745305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:26.746811 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:26.759795 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa4aa-88ad-4e52-bbc9-f136bc8e54bf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:26.765784 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:26.766843 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:26.767247 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:26.767532 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:26.837994 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:26.840217 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:26.851351 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1439/2893] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:27.443778 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:27.456071 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9456a-d256-40ef-abdc-18f8e5a39ead service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:27.462654 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d7b59-a22d-4972-b9b1-6d12e07e65cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8436207924e742caafdc816b373fd40b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:27.463526 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7b59-a22d-4972-b9b1-6d12e07e65cc service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:27.463961 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7b59-a22d-4972-b9b1-6d12e07e65cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:27.464394 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7b59-a22d-4972-b9b1-6d12e07e65cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:27.476552 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d7b59-a22d-4972-b9b1-6d12e07e65cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:27.478036 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d7b59-a22d-4972-b9b1-6d12e07e65cc service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:27.488000 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1455/2894] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:31.402774 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:31.477800 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbeead-2be5-4e4d-a4d6-d9fedcb820ee service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:31.482836 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:31.483529 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:31.483833 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:31.484080 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] PATH_INFO: `/v3/users/4246f6650f82459881b431db8859b580` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:31.485376 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4246f6650f82459881b431db8859b580)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:31.487402 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:31.504521 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:31.536148 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4246f6650f82459881b431db8859b580'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:31.544096 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4246f6650f82459881b431db8859b580'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:31.562118 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4246f6650f82459881b431db8859b580'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:31.570211 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4246f6650f82459881b431db8859b580'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:31.571057 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4246f6650f82459881b431db8859b580'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:31.577330 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1440/2895] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:31 2022] DELETE /identity/v3/users/4246f6650f82459881b431db8859b580 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:31.582472 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:31.582987 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:31.583091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:31.602972 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] MFA Rules not processed for user `2b0c94cc4dbe432d8153b2bd96ed5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 08:49:31.604211 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:31.666670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1456/2896] 10.222.0.47 () {58 vars in 958 bytes} [Fri Jul 29 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 08:49:31.676858 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:31.678312 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:31.736901 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f057-03ab-45a4-b044-ab4412b3bbc7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:31.741007 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:31.741671 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:31.741954 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:31.742230 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:31.751410 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:31.752847 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:31.764206 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1441/2897] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:49:32.057017 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:32.058519 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:32.071583 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f744cb8-265b-4f98-b842-b03a3a7c98f8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:32.079252 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:32.079915 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:32.080190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:32.080471 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] PATH_INFO: `/v3/projects/99dba8222b004b8e83268f540f8a4422` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:32.081811 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dba8222b004b8e83268f540f8a4422)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:32.083935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:32.132921 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:32.136098 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dba8222b004b8e83268f540f8a4422', 'request_id': 'req-21602ee9-0041-4a50-9378-8977330fa0b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.144299 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dba8222b004b8e83268f540f8a4422', 'request_id': 'req-21602ee9-0041-4a50-9378-8977330fa0b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.149994 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dba8222b004b8e83268f540f8a4422', 'request_id': 'req-21602ee9-0041-4a50-9378-8977330fa0b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.161541 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] The token cache is being invalidate because project 99dba8222b004b8e83268f540f8a4422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:32.161830 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.162539 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.164138 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1457/2898] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:32 2022] DELETE /identity/v3/projects/99dba8222b004b8e83268f540f8a4422 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:32.168373 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:32.178798 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd2d8e-1c11-4d24-bc26-ca38effce735 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:32.252929 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:32.253619 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:32.253908 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:32.254189 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] PATH_INFO: `/v3/users/f52052ef0aa843a3a8427fdfb676e637` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:32.255531 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52052ef0aa843a3a8427fdfb676e637)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:32.257502 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:32.301846 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:32.308653 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52052ef0aa843a3a8427fdfb676e637'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.316915 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52052ef0aa843a3a8427fdfb676e637'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.329580 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52052ef0aa843a3a8427fdfb676e637'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.336917 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52052ef0aa843a3a8427fdfb676e637'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.337622 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52052ef0aa843a3a8427fdfb676e637'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.344001 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1442/2899] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:32 2022] DELETE /identity/v3/users/f52052ef0aa843a3a8427fdfb676e637 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:32.627819 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:32.629797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:32.643356 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602ee9-0041-4a50-9378-8977330fa0b4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:32.702453 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:32.703368 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:32.703651 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:32.703924 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] PATH_INFO: `/v3/projects/dd065a10efe945888f2cc806d542ff34` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:32.705074 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd065a10efe945888f2cc806d542ff34)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:32.707042 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:32.758813 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd065a10efe945888f2cc806d542ff34', 'request_id': 'req-659e64f0-162e-4302-80e1-ce6496090915'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.765936 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd065a10efe945888f2cc806d542ff34', 'request_id': 'req-659e64f0-162e-4302-80e1-ce6496090915'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.771480 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd065a10efe945888f2cc806d542ff34', 'request_id': 'req-659e64f0-162e-4302-80e1-ce6496090915'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.782667 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] The token cache is being invalidate because project dd065a10efe945888f2cc806d542ff34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:32.782957 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.783676 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.785677 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1458/2900] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:32 2022] DELETE /identity/v3/projects/dd065a10efe945888f2cc806d542ff34 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:32.789709 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:32.791390 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:32.804837 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8c15-a072-4e8a-8304-b493a1abfda6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:32.865759 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:32.866401 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:32.866686 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:32.866964 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] PATH_INFO: `/v3/users/9de23d6dba864da7834c55d7b24d3e68` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:32.868152 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de23d6dba864da7834c55d7b24d3e68)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:32.870097 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:32.917254 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de23d6dba864da7834c55d7b24d3e68'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.925305 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de23d6dba864da7834c55d7b24d3e68'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.937202 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de23d6dba864da7834c55d7b24d3e68'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.943976 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de23d6dba864da7834c55d7b24d3e68'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.944608 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de23d6dba864da7834c55d7b24d3e68'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:32.950426 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1443/2901] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:49:32 2022] DELETE /identity/v3/users/9de23d6dba864da7834c55d7b24d3e68 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:33.227978 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:49:33.229760 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:49:33.244165 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e64f0-162e-4302-80e1-ce6496090915 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:49:33.313956 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:49:33.314609 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:49:33.314885 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:49:33.315159 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] PATH_INFO: `/v3/projects/124566a2cfa74950b4352eb0f76aa98c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:49:33.316454 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=124566a2cfa74950b4352eb0f76aa98c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:49:33.318421 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:49:33.324708 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:33.366725 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124566a2cfa74950b4352eb0f76aa98c', 'request_id': 'req-90296e96-f713-435f-b667-92e7096017bb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:33.374652 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124566a2cfa74950b4352eb0f76aa98c', 'request_id': 'req-90296e96-f713-435f-b667-92e7096017bb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:33.380249 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124566a2cfa74950b4352eb0f76aa98c', 'request_id': 'req-90296e96-f713-435f-b667-92e7096017bb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:33.391119 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] The token cache is being invalidate because project 124566a2cfa74950b4352eb0f76aa98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:49:33.391413 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:33.392039 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:49:33.393658 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1459/2902] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:49:33 2022] DELETE /identity/v3/projects/124566a2cfa74950b4352eb0f76aa98c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:49:42.947545 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=15,keystone:SELECT=67,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:49:43.388251 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:31.867098 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:50:31.869840 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:32.067417 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a7553-7a78-41d2-a07a-4856a835e4f0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:50:32.136143 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577eab0ae167408086ce9260a4f237e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:50:32.136888 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:50:32.137239 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:50:32.137644 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:50:32.139726 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:32.153576 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:50:32.155237 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:50:32.167526 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1444/2903] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:50:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 08:50:42.163255 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:44.318213 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:50:44.319672 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:44.381043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90296e96-f713-435f-b667-92e7096017bb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:50:44.385091 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2929dcc2eee6498393466499b61d6ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:50:44.385743 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:50:44.386020 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:50:44.386302 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:50:44.388388 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:44.456876 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:50:44.458403 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:50:44.468180 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1460/2904] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:50:47.608500 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:50:47.609983 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:47.702070 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dca77a-86bc-4958-9009-b70c6298db17 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:50:47.707731 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:50:47.708370 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:50:47.708659 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:50:47.708932 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:50:47.710747 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:47.723337 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:50:47.724959 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:50:47.736992 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1445/2905] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:50:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:50:50.856438 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:50:50.858233 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:50.871208 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe519d-39d4-4d9f-890e-8be33c3c695c service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:50:50.875752 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:50:50.876399 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:50:50.876670 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:50:50.876945 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] PATH_INFO: `/v3/users/8ed5256562974246b15e474439811df4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:50:50.878142 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed5256562974246b15e474439811df4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:50:50.880078 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:50:50.931528 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed5256562974246b15e474439811df4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:50.938791 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed5256562974246b15e474439811df4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:50.946976 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed5256562974246b15e474439811df4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:50.959473 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed5256562974246b15e474439811df4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:50.960106 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed5256562974246b15e474439811df4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:50.965932 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1461/2906] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:50:50 2022] DELETE /identity/v3/users/8ed5256562974246b15e474439811df4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:50:51.156809 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:50:51.168236 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1288feb-51c7-4c79-95a9-8d39b279330a service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:50:51.225955 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:50:51.226601 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:50:51.226880 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:50:51.227154 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] PATH_INFO: `/v3/projects/89452dc908b24817947b096a443e0e8f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:50:51.228314 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89452dc908b24817947b096a443e0e8f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:50:51.230324 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:50:51.279875 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89452dc908b24817947b096a443e0e8f', 'request_id': 'req-027e3ae7-7e48-49bc-92ef-85cc317742a0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.285473 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89452dc908b24817947b096a443e0e8f', 'request_id': 'req-027e3ae7-7e48-49bc-92ef-85cc317742a0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.294158 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89452dc908b24817947b096a443e0e8f', 'request_id': 'req-027e3ae7-7e48-49bc-92ef-85cc317742a0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.306651 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] The token cache is being invalidate because project 89452dc908b24817947b096a443e0e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:50:51.306947 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.307593 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.309137 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1446/2907] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:50:51 2022] DELETE /identity/v3/projects/89452dc908b24817947b096a443e0e8f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:50:51.313253 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:50:51.314673 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:51.328749 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deefc5-178a-4893-b8e2-235a7509ab20 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:50:51.341727 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:51.388889 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:50:51.389575 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:50:51.389852 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:50:51.390103 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] PATH_INFO: `/v3/users/b4d835de655f4834bb92bd94be45e340` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:50:51.391367 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d835de655f4834bb92bd94be45e340)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:50:51.393307 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:50:51.439470 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d835de655f4834bb92bd94be45e340'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.446550 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d835de655f4834bb92bd94be45e340'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.455601 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d835de655f4834bb92bd94be45e340'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.469133 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d835de655f4834bb92bd94be45e340'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.469886 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d835de655f4834bb92bd94be45e340'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.476050 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1462/2908] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Jul 29 08:50:51 2022] DELETE /identity/v3/users/b4d835de655f4834bb92bd94be45e340 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:50:51.655741 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:50:51.657203 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:50:51.672399 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e3ae7-7e48-49bc-92ef-85cc317742a0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:50:51.691021 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:51.734465 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b0c94cc4dbe432d8153b2bd96ed5e97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '946d886e0ff64f17b40801862b894e7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:50:51.735198 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:50:51.735487 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:50:51.735772 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] PATH_INFO: `/v3/projects/16ca9e31760546f7a1f636598ec97b8e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:50:51.736975 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ca9e31760546f7a1f636598ec97b8e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:50:51.738933 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:50:51.785121 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ca9e31760546f7a1f636598ec97b8e', 'request_id': 'req-8c099384-b12b-4c05-ace3-7d383da534f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.790802 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ca9e31760546f7a1f636598ec97b8e', 'request_id': 'req-8c099384-b12b-4c05-ace3-7d383da534f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.800790 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ca9e31760546f7a1f636598ec97b8e', 'request_id': 'req-8c099384-b12b-4c05-ace3-7d383da534f6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.811869 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] The token cache is being invalidate because project 16ca9e31760546f7a1f636598ec97b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 08:50:51.812163 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.812805 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8c099384-b12b-4c05-ace3-7d383da534f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 08:50:51.814362 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1447/2909] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Jul 29 08:50:51 2022] DELETE /identity/v3/projects/16ca9e31760546f7a1f636598ec97b8e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 08:51:01.472797 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:51:01.809183 dv-cinder-819149-15-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:51:33.579231 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 08:51:33.580935 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:51:33.676190 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31711-ed4c-491d-8aa8-7bd97aff9698 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 08:51:33.743043 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec950587-5c9f-4a80-9c8c-6902e7acb299 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8535cea602d743dfa892160338ebfd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd5b9fc19454a10822fbe087a81423c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 08:51:33.743704 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950587-5c9f-4a80-9c8c-6902e7acb299 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 08:51:33.743985 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950587-5c9f-4a80-9c8c-6902e7acb299 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 08:51:33.744260 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950587-5c9f-4a80-9c8c-6902e7acb299 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 08:51:33.746173 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ec950587-5c9f-4a80-9c8c-6902e7acb299 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 08:51:33.757796 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec950587-5c9f-4a80-9c8c-6902e7acb299 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 08:51:33.759424 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec950587-5c9f-4a80-9c8c-6902e7acb299 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 08:51:33.769909 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1463/2910] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Jul 29 08:51:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 08:51:43.765521 dv-cinder-819149-15-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=67 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}